Transformer in FINN: Scaled Dot-Product Attention#13

Merged

iksnagreb merged 90 commits intodevfrom

feature/attention

Feb 6, 2025

Commits on Apr 3, 2024

Commits on Apr 8, 2024

[Refactor] Fix Split/MergeMultiHeads and ReplicateStream C++/RTL tests
iksnagreb
committed
[ReplicateStream] Introduce configurable PE parallelism for streams
iksnagreb
committed

Commits on Apr 26, 2024

[Streamline] Fix eager access to potentially empty successors list
iksnagreb
committed

Commits on May 3, 2024

[Attention] Implement get_exp_cycles for attention-related HWCustomOps
iksnagreb
committed
Add support for ReplicateStream_hls as a PE-operation to SetFolding
iksnagreb
committed

Commits on May 10, 2024

[Attention] Add method to get the number of folded inputs
iksnagreb
committed

Commits on May 16, 2024

Commits on May 17, 2024

[Attention] Refactor RAM_STYLES dictionary
iksnagreb
committed

Commits on May 21, 2024

[Attention] Redirect RTL simulation of attention to Python execution
iksnagreb
committed

Commits on Jun 8, 2024

[Attention] Add missing constant mask mode to input shape query
iksnagreb
committed

Commits on Jun 14, 2024

[Attention] Fix Resource::URAM typo
iksnagreb
committed

Commits on Aug 5, 2024

[Attention] Add data layout checks to InferMultiHeads transformation
iksnagreb
committed

Commits on Aug 7, 2024

Commits on Aug 28, 2024

[Streamline] Prevent MoveTransposePastEltwise from transposing scalars
iksnagreb
committed

Commits on Jan 20, 2025

Commits on Jan 21, 2025

Commits on Jan 28, 2025

[Deps] Update attention-hlslib dependency
iksnagreb
committed

Commits on Feb 6, 2025

Merge remote-tracking branch 'eki-project/dev' into feature/attention
iksnagreb
committed