Llama: Merge query/key/value projection layers - #498

Open

mryab wants to merge 8 commits into

mainfrom

Commits on Sep 2, 2023

Add dry_run option to --throughput
mryab
committed
b2ab84c
Merge query/key/value projection layers
mryab
committed
57119bb
Remove unused import in throughput.py
mryab
committed
c666a97
Ignore missing qkv_proj.weight when loading a checkpoint
mryab
committed
4644131
Reformat code with black
mryab
committed
f100915
Fix removal of nonexistent keys
mryab
committed
16fb547
Fix checking for nonexistent keys
mryab
committed
9cb4c72

Commits on Sep 3, 2023

Create dummy data when materializing qkv_proj
mryab
committed
4159e55