Tensor and Operator Basics
Driss Guessous edited this page Apr 29, 2024
·
4 revisions
- Understand what an operator is in PyTorch
- Understand what a Tensor is (including stride, dtype, and layout)
- Understand what views are
- Understand how to author an operator in PyTorch
- Understand how to test operators in PyTorch
- Understand what TensorIterator is
A Tensor consists of:
- data_ptr, a pointer to a chunk of memory
- some sizes metadata
- some strides metadata
- a storage offset
- After completing the views lab if you have extra time feel free to work through Sasha Rush's Tensor Puzzles
- Install Prerequisites
- Fork, clone, and checkout the PyTorch source
- Install Dependencies
- Build PyTorch from source
- Tips for developing PyTorch
- PyTorch Workflow Git cheatsheet
- Overview of the Pull Request Lifecycle
- Finding Or Reporting Issues
- Pre Commit Checks
- Create a Pull Request
- Typical Pull Request Workflow
- Pull Request FAQs
- Getting Help
- Codebase structure
- Tensors, Operators, and Testing
- Autograd
- Dispatcher, Structured Kernels, and Codegen
- torch.nn
- CUDA basics
- Data (Optional)
- function transforms (Optional)