Code

RoPE embeddings#78

Code

Open

shaikh58 wants to merge 66 commits intomaintalmolab/dreem:mainfrom mustafa-ropetalmolab/dreem:mustafa-ropeCopy head branch name to clipboard

+968-201

Commits

Commits on Jul 31, 2024

• create notebook for dev

  shaikh58

  committed
  16d7bc4

  Copy full SHA for 16d7bc4

• test update of notebook

  shaikh58

  committed
  6f2c7ad

  Copy full SHA for 6f2c7ad

Commits on Aug 2, 2024

• implement rope embedding

  Show description for b82c4d4
  shaikh58

  committed
  b82c4d4

  Copy full SHA for b82c4d4

Commits on Aug 5, 2024

• minor changes - add batch job file to repo

  shaikh58

  committed
  a07ea57

  Copy full SHA for a07ea57

• add local train run script, minor changes

  shaikh58

  committed
  6d135fb

  Copy full SHA for 6d135fb

• Update rope.ipynb

  shaikh58

  committed
  4714aea

  Copy full SHA for 4714aea

Commits on Aug 6, 2024

• refactor transformer encoder

  Show description for 9c64789
  shaikh58

  committed
  9c64789

  Copy full SHA for 9c64789

• further changes for rope

  Show description for 67bf6e4
  shaikh58

  committed
  67bf6e4

  Copy full SHA for 67bf6e4

• complete encoder section of rope

  Show description for fa61af0
  shaikh58

  committed
  fa61af0

  Copy full SHA for fa61af0

Commits on Aug 7, 2024

• setup batch training

  shaikh58

  committed
  55f5f25

  Copy full SHA for 55f5f25

• remove batch run commands from repo

  shaikh58

  committed
  9cec3a2

  Copy full SHA for 9cec3a2

• remove batch training script

  shaikh58

  committed
  f02a173

  Copy full SHA for f02a173

• Update base.yaml

  shaikh58

  committed
  287c475

  Copy full SHA for 287c475

• Merge branch 'mustafa-rope' of https://github.com/talmolab/dreem into mustafa-rope

  shaikh58

  committed
  a7e3a56

  Copy full SHA for a7e3a56

• Update run_trainer.py

  shaikh58

  committed
  5d4bf5e

  Copy full SHA for 5d4bf5e

• Update .gitignore

  shaikh58

  committed
  f23ef5c

  Copy full SHA for f23ef5c

• comments for tracker.py

  shaikh58

  committed
  785df8f

  Copy full SHA for 785df8f

Commits on Aug 8, 2024

• embedding bug fixes for encoder

  Show description for 3d3f2ca
  shaikh58

  committed
  3d3f2ca

  Copy full SHA for 3d3f2ca

Commits on Aug 9, 2024

• implement rope for decoder

  Show description for 6af9e17
  shaikh58

  committed
  6af9e17

  Copy full SHA for 6af9e17

• final attn head supports stack embeddings

  Show description for 6928078
  shaikh58

  committed
  6928078

  Copy full SHA for 6928078

Commits on Aug 10, 2024

• Update tests, add new unit tests for rope

  Show description for c4b1124
  shaikh58

  committed
  c4b1124

  Copy full SHA for c4b1124

Commits on Aug 12, 2024

• rope bug fixes

  Show description for 62f2c03
  shaikh58

  committed
  62f2c03

  Copy full SHA for 62f2c03

• minor update to previous commit

  shaikh58

  committed
  9292bbc

  Copy full SHA for 9292bbc

Commits on Aug 15, 2024

• fix device mismatch in mlp module

  shaikh58

  committed
  3751de0

  Copy full SHA for 3751de0

• support for adding embedding to instance

  shaikh58

  committed
  3d1a35e

  Copy full SHA for 3d1a35e

Commits on Aug 16, 2024

• bug fixes to pass unit tests

  Show description for c4abac2
  shaikh58

  committed
  c4abac2

  Copy full SHA for c4abac2

• minor updates from PR review

  shaikh58

  committed
  5a7e86b

  Copy full SHA for 5a7e86b

• allow batch eval/inference flexibility rather than just different model checkpoints

  aaprasad

  committed
  9eddead

  Copy full SHA for 9eddead

Commits on Aug 19, 2024

• linting

  shaikh58

  committed
  d5993a9

  Copy full SHA for d5993a9

Commits on Aug 26, 2024

• add cross attn for rope-stack before final asso matrix output

  shaikh58

  committed
  bcb661a

  Copy full SHA for bcb661a

Commits on Aug 27, 2024

• minor bug fix in rope embedding for single instance clips

  shaikh58

  committed
  fd77ded

  Copy full SHA for fd77ded

Commits on Aug 30, 2024

• use sleap-io as video backend instead of imageio

  aaprasad

  committed
  41454f7

  Copy full SHA for 41454f7

• lint

  aaprasad

  committed
  64c970b

  Copy full SHA for 64c970b

Commits on Sep 27, 2024

• create notebook for dev

  shaikh58

  committed
  b63f24f

  Copy full SHA for b63f24f

• test update of notebook

  shaikh58

  committed
  c320eea

  Copy full SHA for c320eea

• implement rope embedding

  Show description for 21035fb
  shaikh58

  committed
  21035fb

  Copy full SHA for 21035fb

• minor changes - add batch job file to repo

  shaikh58

  committed
  4d27914

  Copy full SHA for 4d27914

• add local train run script, minor changes

  shaikh58

  committed
  be5e630

  Copy full SHA for be5e630

• Update rope.ipynb

  shaikh58

  committed
  dba9f08

  Copy full SHA for dba9f08

• refactor transformer encoder

  Show description for 0dd6a60
  shaikh58

  committed
  0dd6a60

  Copy full SHA for 0dd6a60

• further changes for rope

  Show description for e492909
  shaikh58

  committed
  e492909

  Copy full SHA for e492909

• complete encoder section of rope

  Show description for 4140524
  shaikh58

  committed
  4140524

  Copy full SHA for 4140524

• setup batch training

  shaikh58

  committed
  a1ca23e

  Copy full SHA for a1ca23e

• remove batch run commands from repo

  shaikh58

  committed
  b5fa58d

  Copy full SHA for b5fa58d

• Update base.yaml

  shaikh58

  committed
  c721e90

  Copy full SHA for c721e90

• remove batch training script

  shaikh58

  committed
  6711697

  Copy full SHA for 6711697

• Update run_trainer.py

  shaikh58

  committed
  20fd4a7

  Copy full SHA for 20fd4a7

• Update .gitignore

  shaikh58

  committed
  9ac41a8

  Copy full SHA for 9ac41a8

• comments for tracker.py

  shaikh58

  committed
  c43ee75

  Copy full SHA for c43ee75

• embedding bug fixes for encoder

  Show description for fe1eeca
  shaikh58

  committed
  fe1eeca

  Copy full SHA for fe1eeca

• implement rope for decoder

  Show description for 2da8c09
  shaikh58

  committed
  2da8c09

  Copy full SHA for 2da8c09

• final attn head supports stack embeddings

  Show description for 65a4ae0
  shaikh58

  committed
  65a4ae0

  Copy full SHA for 65a4ae0

• Update tests, add new unit tests for rope

  Show description for 7c38ad4
  shaikh58

  committed
  7c38ad4

  Copy full SHA for 7c38ad4

• rope bug fixes

  Show description for 8b552ef
  shaikh58

  committed
  8b552ef

  Copy full SHA for 8b552ef

• minor update to previous commit

  shaikh58

  committed
  8fdfba1

  Copy full SHA for 8fdfba1

• fix device mismatch in mlp module

  shaikh58

  committed
  03df33f

  Copy full SHA for 03df33f

• support for adding embedding to instance

  shaikh58

  committed
  1d2f5a5

  Copy full SHA for 1d2f5a5

• bug fixes to pass unit tests

  Show description for 5a5f75f
  shaikh58

  committed
  5a5f75f

  Copy full SHA for 5a5f75f

• minor updates from PR review

  shaikh58

  committed
  3ff1ab0

  Copy full SHA for 3ff1ab0

• linting

  shaikh58

  committed
  fe2c88e

  Copy full SHA for fe2c88e

• add cross attn for rope-stack before final asso matrix output

  shaikh58

  committed
  de2ace9

  Copy full SHA for de2ace9

• minor bug fix in rope embedding for single instance clips

  shaikh58

  committed
  9b29171

  Copy full SHA for 9b29171

• Merge branch 'mustafa-rope' of https://github.com/talmolab/dreem into mustafa-rope

  shaikh58

  committed
  3bc9fef

  Copy full SHA for 3bc9fef

Commits on Oct 9, 2024

• - Started implementation for post processing fixes; no logic changes

  Show description for 1998f6f
  shaikh58

  committed
  1998f6f

  Copy full SHA for 1998f6f

Commits on Dec 13, 2024

• Merge branch 'main' into mustafa-rope

  shaikh58

  committed
  2792d13

  Copy full SHA for 2792d13

• merge bug fixes

  shaikh58

  committed
  e4ce29c

  Copy full SHA for e4ce29c