How is einx notation universal?
3 days ago
- #tensor-operations
- #einx-notation
- #vectorization
- Tensor operations consist of an elementary operation and vectorization over sub-tensors.
- Existing frameworks like Numpy, PyTorch, TensorFlow, and Jax use different vectorization rules for different operations.
- einx notation provides a universal interface for tensor operations with consistent and complete vectorization rules.
- einx decouples elementary operations from vectorization, offering one API per operation.
- einx notation can express any operation possible with tools like jax.vmap.
- Examples show how classical API calls map to einx operations, highlighting consistency and completeness.
- Despite conceptual decoupling, einx leverages efficient backend implementations (e.g., matmul) for performance.