Optimizing FasTensor: Enabling Efficient Tensor Execution on GPUs

Greetings,

I am Rishabh Singh, and I am excited to be part of the 2023 Google Summer of code program. My proposal under the mentorship of John Wu and Bin Dong focuses on optimizing the FasTensor tensor computing library for efficient usage on GPUs, specifically targeting tensor contraction while preserving structure-locality. This optimization is crucial for scientific applications and advanced AI model training. Throughout the project, I will develop custom computational operations for GPUs, implement FasTensor on GPUs, assess its performance, and provide comprehensive documentation. By the end, I aim to deliver a working implementation, a performance report, and a detailed execution mechanism guide. Leveraging my background in software engineering and machine learning, I will utilize languages like C++ and OpenMP to ensure efficient memory management and data movement. Stay tuned for regular updates and informative blogs as I progress through the summer.