FasTensor

FasTensor is a parallel execution engine for user-defined functions on multidimensional arrays. The user-defined functions follow the stencil metaphor used for scientific computing and is effective for expressing a wide range of computations for data analyses, including common aggregation operations from database management systems and advanced machine learning pipelines. FasTensor execution engine exploits the structural-locality in the multidimensional arrays to automate data management operations such as file I/O, data partitioning, communication, parallel execution, and so on.

Continuous Integration

  • Topics: Data Management, Analytics
  • Skills: C++, github
  • Difficulty: Medium
  • Size: Large (350 hours)
  • Mentor: John Wu, Bin Dong, Suren Byna
  • Develop a test suite for the public API of FasTensor
  • Automate execution of the test suite
  • Document the continuous integration process
  • Develop performance testing suite