{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":323651234,"defaultBranch":"main","name":"gpt-neox","ownerLogin":"EleutherAI","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2020-12-22T14:37:54.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/68924597?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726707535.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"053f67eedbc6f9c7ee591ef2caf676693df473e4","ref":"refs/heads/add-reinforce","pushedAt":"2024-09-19T00:58:55.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dmahan93","name":null,"path":"/dmahan93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/44207705?s=80&v=4"},"commit":{"message":"- Add reinforce\n- Add reinforce leave one out\n- Add model weight sharing via pointers\n- Add online dataset","shortMessageHtmlLink":"- Add reinforce"}},{"before":"9322532f278eb92feff7bf96bb5ea0852b83236d","after":null,"ref":"refs/heads/qanthony/monitor-consistency","pushedAt":"2024-09-18T00:27:50.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"55b75124e45a1232949e3de68ba504067f16723b","after":"54af72a7ccda8326edbcb3d79cb6899efb3a2bbc","ref":"refs/heads/main","pushedAt":"2024-09-18T00:27:49.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Remove the remaining two hanging wandb config fields (#1287)\n\n* Make monitor sections consistent. Separate wandb config from local_setup.\r\n\r\n* remove wandb as default from remaining configs\r\n\r\n* remove wandb as default from remaining configs","shortMessageHtmlLink":"Remove the remaining two hanging wandb config fields (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2532433595\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1287\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1287/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1287\">#1287</a>)"}},{"before":"87b6c8882fc7a87d94d22d0699b2d14bf72f7f3e","after":"9322532f278eb92feff7bf96bb5ea0852b83236d","ref":"refs/heads/qanthony/monitor-consistency","pushedAt":"2024-09-18T00:26:47.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Merge branch 'qanthony/monitor-consistency' of https://github.com/EleutherAI/gpt-neox into qanthony/monitor-consistency","shortMessageHtmlLink":"Merge branch 'qanthony/monitor-consistency' of <a href=\"https://github.com/EleutherAI/gpt-neox\">https://github.com/Ele…</a>"}},{"before":null,"after":"87b6c8882fc7a87d94d22d0699b2d14bf72f7f3e","ref":"refs/heads/qanthony/monitor-consistency","pushedAt":"2024-09-18T00:26:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"remove wandb as default from remaining configs","shortMessageHtmlLink":"remove wandb as default from remaining configs"}},{"before":"728ce7da61de4552fb1a77652a6323d1cb8e2600","after":null,"ref":"refs/heads/qanthony/monitor-consistency","pushedAt":"2024-09-18T00:23:26.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"f9b5329d6102d6af6ff6303329eddb892d4011cc","after":"55b75124e45a1232949e3de68ba504067f16723b","ref":"refs/heads/main","pushedAt":"2024-09-18T00:23:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Make monitor sections consistent. Separate wandb config from local_setup. (#1286)","shortMessageHtmlLink":"Make monitor sections consistent. Separate wandb config from local_se…"}},{"before":null,"after":"728ce7da61de4552fb1a77652a6323d1cb8e2600","ref":"refs/heads/qanthony/monitor-consistency","pushedAt":"2024-09-18T00:21:31.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Make monitor sections consistent. Separate wandb config from local_setup.","shortMessageHtmlLink":"Make monitor sections consistent. Separate wandb config from local_se…"}},{"before":"5b4446d9cb4652b08989f0734dcda7bfece081d3","after":null,"ref":"refs/heads/rm-mask-off-by-1-token","pushedAt":"2024-09-18T00:00:40.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"c8b3106fd910bc1cf5a3436944e580e356304cca","after":"f9b5329d6102d6af6ff6303329eddb892d4011cc","ref":"refs/heads/main","pushedAt":"2024-09-18T00:00:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Update preprocess_data_with_chat_template.py (#1285)","shortMessageHtmlLink":"Update preprocess_data_with_chat_template.py (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2531356944\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1285\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1285/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1285\">#1285</a>)"}},{"before":"f2812102cab4399b7f1a04cb6ae029c9565785a6","after":"c8b3106fd910bc1cf5a3436944e580e356304cca","ref":"refs/heads/main","pushedAt":"2024-09-18T00:00:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Update Comet integration instructions (#1284)\n\n* Update Comet integration instructions\r\n\r\n* Set minimum version of compatible Comet SDK\r\n* Add Comet in the Readme where other logging integrations are mentioned\r\n* Fix typo in Comet instructions and de-emphasize the Comet workspace, most\r\n  users have a single Comet workspace and it's not needed to set it to start\r\n  logging\r\n\r\n* minor proofreading\r\n\r\n---------\r\n\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Update Comet integration instructions (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2531176021\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1284\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1284/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1284\">#1284</a>)"}},{"before":null,"after":"5b4446d9cb4652b08989f0734dcda7bfece081d3","ref":"refs/heads/rm-mask-off-by-1-token","pushedAt":"2024-09-17T14:39:10.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dmahan93","name":null,"path":"/dmahan93","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/44207705?s=80&v=4"},"commit":{"message":"Update preprocess_data_with_chat_template.py","shortMessageHtmlLink":"Update preprocess_data_with_chat_template.py"}},{"before":null,"after":"f32f27ad6caa1fd12afef24e08b252de86a21ac3","ref":"refs/heads/auto-itercount","pushedAt":"2024-09-16T19:42:00.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"AI-WAIFU","name":null,"path":"/AI-WAIFU","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/67525070?s=80&v=4"},"commit":{"message":"first working iteration","shortMessageHtmlLink":"first working iteration"}},{"before":"7156a45c81bd0bc4b259645521260e3726f38a4f","after":null,"ref":"refs/heads/fix-reduce-scatter","pushedAt":"2024-09-15T03:39:52.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"d79c53314f422677f648ae257b81282f7d1bc28c","after":"f2812102cab4399b7f1a04cb6ae029c9565785a6","ref":"refs/heads/main","pushedAt":"2024-09-15T03:39:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Add model parallel group to reduce scatter (#1281)","shortMessageHtmlLink":"Add model parallel group to reduce scatter (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2526635345\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1281\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1281/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1281\">#1281</a>)"}},{"before":"d79c53314f422677f648ae257b81282f7d1bc28c","after":"7156a45c81bd0bc4b259645521260e3726f38a4f","ref":"refs/heads/fix-reduce-scatter","pushedAt":"2024-09-14T22:24:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bclyang","name":"Brandon Yang","path":"/bclyang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6700915?s=80&v=4"},"commit":{"message":"Add model parallel group to reduce scatter","shortMessageHtmlLink":"Add model parallel group to reduce scatter"}},{"before":null,"after":"d79c53314f422677f648ae257b81282f7d1bc28c","ref":"refs/heads/fix-reduce-scatter","pushedAt":"2024-09-14T22:21:37.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"bclyang","name":"Brandon Yang","path":"/bclyang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6700915?s=80&v=4"},"commit":{"message":"Add KTO training (#1244)\n\n* Add a chat data preprocessing script\r\n\r\n* add EOT at end of a chat\r\n\r\n* - add different packing impl (Unpacked, packing until overflow)\r\n- fix labels to also have valid/test implementations\r\n- fix label masking in _get_batch to also include anything from get_ltor_masks_and_position_ids\r\n\r\n* update README.md\r\n\r\n* - Add metrics to forward step to add DPO specific metrics that are useful (accuracy, etc)\r\n- Add reference model setup for DPO\r\n- Add pairwise dataset for positive/negative pairs\r\n- Add DPO loss\r\n\r\n* Update arguments.py to use train_label_data_paths instead of label_data_paths\r\n\r\n* - Bugfixes from upstreaming....\r\n\r\n* - add precompute logprobs...\r\n\r\n* - Finishing up precompute logprobs...\r\n\r\n* - update readme for DPO...\r\n\r\n* - Add KTO\r\n\r\n* Update README.md\r\n\r\n* precommit\r\n\r\n* - KTO implementation from main...\r\n\r\n* initial changes...\r\n\r\n* pre-commit...\r\n\r\n* hotfix + data loader update\r\n\r\n* - add different packing impl (Unpacked, packing until overflow)\r\n- fix labels to also have valid/test implementations\r\n- fix label masking in _get_batch to also include anything from get_ltor_masks_and_position_ids\r\n\r\n* - Add metrics to forward step to add DPO specific metrics that are useful (accuracy, etc)\r\n- Add reference model setup for DPO\r\n- Add pairwise dataset for positive/negative pairs\r\n- Add DPO loss\r\n\r\n* - Bugfixes from upstreaming....\r\n\r\n* - Add KTO\r\n\r\n* Update README.md\r\n\r\n* precommit\r\n\r\n* - KTO implementation from main...\r\n\r\n* initial changes...\r\n\r\n* pre-commit...\r\n\r\n* hotfix + data loader update\r\n\r\n* precommit\r\n\r\n---------\r\n\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Add KTO training (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2380626406\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1244\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1244/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1244\">#1244</a>)"}},{"before":"4a2e726c11d32cc9cb7f56f6092794e82cbc04b1","after":"d79c53314f422677f648ae257b81282f7d1bc28c","ref":"refs/heads/main","pushedAt":"2024-09-14T07:56:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Add KTO training (#1244)\n\n* Add a chat data preprocessing script\r\n\r\n* add EOT at end of a chat\r\n\r\n* - add different packing impl (Unpacked, packing until overflow)\r\n- fix labels to also have valid/test implementations\r\n- fix label masking in _get_batch to also include anything from get_ltor_masks_and_position_ids\r\n\r\n* update README.md\r\n\r\n* - Add metrics to forward step to add DPO specific metrics that are useful (accuracy, etc)\r\n- Add reference model setup for DPO\r\n- Add pairwise dataset for positive/negative pairs\r\n- Add DPO loss\r\n\r\n* Update arguments.py to use train_label_data_paths instead of label_data_paths\r\n\r\n* - Bugfixes from upstreaming....\r\n\r\n* - add precompute logprobs...\r\n\r\n* - Finishing up precompute logprobs...\r\n\r\n* - update readme for DPO...\r\n\r\n* - Add KTO\r\n\r\n* Update README.md\r\n\r\n* precommit\r\n\r\n* - KTO implementation from main...\r\n\r\n* initial changes...\r\n\r\n* pre-commit...\r\n\r\n* hotfix + data loader update\r\n\r\n* - add different packing impl (Unpacked, packing until overflow)\r\n- fix labels to also have valid/test implementations\r\n- fix label masking in _get_batch to also include anything from get_ltor_masks_and_position_ids\r\n\r\n* - Add metrics to forward step to add DPO specific metrics that are useful (accuracy, etc)\r\n- Add reference model setup for DPO\r\n- Add pairwise dataset for positive/negative pairs\r\n- Add DPO loss\r\n\r\n* - Bugfixes from upstreaming....\r\n\r\n* - Add KTO\r\n\r\n* Update README.md\r\n\r\n* precommit\r\n\r\n* - KTO implementation from main...\r\n\r\n* initial changes...\r\n\r\n* pre-commit...\r\n\r\n* hotfix + data loader update\r\n\r\n* precommit\r\n\r\n---------\r\n\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Add KTO training (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2380626406\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1244\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1244/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1244\">#1244</a>)"}},{"before":"a6d82ea64680df19cd9ced860296a4bffce184ee","after":"4a2e726c11d32cc9cb7f56f6092794e82cbc04b1","ref":"refs/heads/main","pushedAt":"2024-09-14T07:30:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Post training examples (#1277)\n\n* - Add examples for post training\r\n\r\n* - remove hanging kto...\r\n\r\n* - reference free fix\r\n- updates to 20b config after testing perf\r\n\r\n* Update llama3-8b-dpo.yml\r\n\r\n* Update llama3-8b-rm.yml\r\n\r\n* Update llama3-8b-dpo.yml\r\n\r\n* Update llama3-8b-sft.yml\r\n\r\n* - flash attn swiglu looks really good, and since we already have flash attention... added an arg for it\r\n- Making sure grads don't accidentally get enabled when we're in eval mode...\r\n- set reference model to eval\r\n- inference mode for reference model\r\n\r\n* - fix in conversion script to hf\r\n- add rms to conversion script\r\n- fix post-training README.md\r\n\r\n* - fix new hf tokenizer conversion\r\n- add conversion to post-training readme","shortMessageHtmlLink":"Post training examples (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2516794098\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1277\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1277/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1277\">#1277</a>)"}},{"before":"3bd8521cef2aee0065aba78cd1339eb54d0ebb67","after":null,"ref":"refs/heads/qanthony/fix-imports","pushedAt":"2024-09-11T00:08:26.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"e37ad2f0d4414ea6f42fc9ca53b75cff3be13b62","after":"a6d82ea64680df19cd9ced860296a4bffce184ee","ref":"refs/heads/main","pushedAt":"2024-09-11T00:08:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"fix the imports needed for comet integration (#1279)","shortMessageHtmlLink":"fix the imports needed for comet integration (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2518189128\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1279\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1279/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1279\">#1279</a>)"}},{"before":null,"after":"3bd8521cef2aee0065aba78cd1339eb54d0ebb67","ref":"refs/heads/qanthony/fix-imports","pushedAt":"2024-09-11T00:08:00.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"fix the imports needed for comet integration","shortMessageHtmlLink":"fix the imports needed for comet integration"}},{"before":"adbf5d6f65f185718f5f5909f1191f54b25ec29d","after":"e37ad2f0d4414ea6f42fc9ca53b75cff3be13b62","ref":"refs/heads/main","pushedAt":"2024-09-10T23:50:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"fix gpt-j residual bias assumption (#1278)","shortMessageHtmlLink":"fix gpt-j residual bias assumption (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517830376\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1278\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1278/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1278\">#1278</a>)"}},{"before":"c1ae1d7720232f8919189fa2e0950308e9b22138","after":"adbf5d6f65f185718f5f5909f1191f54b25ec29d","ref":"refs/heads/main","pushedAt":"2024-09-10T23:46:45.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Hotfix llama models (#1276)\n\n* ParallelMLP Implementation\r\n\r\n* Update neox_args.py to support llama mlp\r\n\r\n* Update transformer.py to support bias and llama stuff\r\n\r\n* remove some stuff from draft pr\r\n\r\n* remove mlp_type arg\r\n\r\n* Update convert_neox_to_hf.py for ParallelMLP llama support\r\n\r\n* change layer names\r\n\r\n* conversion script fix\r\n\r\n* fix multiple_of\r\n\r\n* neox args fix\r\n\r\n* rebase, cleanup, and precommit\r\n\r\n---------\r\n\r\nCo-authored-by: jahatef <hatef.4@buckeyemail.osu.edu>\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Hotfix llama models (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2514774335\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1276\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1276/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1276\">#1276</a>)"}},{"before":"2d70c9706ee1d7c76238d2ea72d79db093d54f23","after":null,"ref":"refs/heads/add-assert-1251","pushedAt":"2024-09-09T19:22:19.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"}},{"before":"17fb83f25c04dde74446e36d0969de8b63d7cbcf","after":"c1ae1d7720232f8919189fa2e0950308e9b22138","ref":"refs/heads/main","pushedAt":"2024-09-09T19:22:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Add more informative checks for ZeRO incompatibility. (#1275)\n\n* add more informative checks for ZeRO incompatibility, fix is_pipe_parallel check\r\n\r\n* add more informative checks for ZeRO incompatibility, fix is_pipe_parallel comment\r\n\r\n* precommit\r\n\r\n---------\r\n\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Add more informative checks for ZeRO incompatibility. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2514416464\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1275\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1275/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1275\">#1275</a>)"}},{"before":"1f23c81957c009d3d6c22f5c4784edcc31234950","after":"2d70c9706ee1d7c76238d2ea72d79db093d54f23","ref":"refs/heads/add-assert-1251","pushedAt":"2024-09-09T19:21:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"precommit","shortMessageHtmlLink":"precommit"}},{"before":"1d1db2364338296855c9a1d1f9fe21c901c2a965","after":"1f23c81957c009d3d6c22f5c4784edcc31234950","ref":"refs/heads/add-assert-1251","pushedAt":"2024-09-09T17:19:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"AI-WAIFU","name":null,"path":"/AI-WAIFU","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/67525070?s=80&v=4"},"commit":{"message":"add more informative checks for ZeRO incompatibility, fix is_pipe_parallel comment","shortMessageHtmlLink":"add more informative checks for ZeRO incompatibility, fix is_pipe_par…"}},{"before":"a9aff20360e7fea48fa74862dff1f74058f1e6e1","after":"17fb83f25c04dde74446e36d0969de8b63d7cbcf","ref":"refs/heads/main","pushedAt":"2024-09-09T17:09:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Quentin-Anthony","name":"Quentin Anthony","path":"/Quentin-Anthony","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/10281105?s=80&v=4"},"commit":{"message":"Comet integration (#1261)\n\n* First version of the GPT-Neox <> Comet integration\r\n\r\n* Add basic Comet configuration\r\n\r\n* Add configuration options for customizing the experiment name, tags and others fields\r\n\r\n* Change one type hint to make validate_types happy\r\n\r\n* Add debugging logs\r\n\r\n* Fix typo\r\n\r\n* Fix typo\r\n\r\n* pre-commit and logging cleanup\r\n\r\n* add comets requirements file\r\n\r\n* First version of the GPT-Neox <> Comet integration\r\n\r\n* Add basic Comet configuration\r\n\r\n* Add configuration options for customizing the experiment name, tags and others fields\r\n\r\n* Change one type hint to make validate_types happy\r\n\r\n* Add debugging logs\r\n\r\n* Fix typo\r\n\r\n* Fix typo\r\n\r\n* pre-commit and logging cleanup\r\n\r\n* add comets requirements file\r\n\r\n* precommit\r\n\r\n* add comet config\r\n\r\n* update readme and arg comment\r\n\r\n* revert unrelated config changes\r\n\r\n---------\r\n\r\nCo-authored-by: Boris Feld <boris@comet.com>\r\nCo-authored-by: Quentin Anthony <qganthony@yahoo.com>","shortMessageHtmlLink":"Comet integration (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2475910493\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EleutherAI/gpt-neox/issues/1261\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EleutherAI/gpt-neox/pull/1261/hovercard\" href=\"https://github.com/EleutherAI/gpt-neox/pull/1261\">#1261</a>)"}},{"before":null,"after":"1d1db2364338296855c9a1d1f9fe21c901c2a965","ref":"refs/heads/add-assert-1251","pushedAt":"2024-09-09T16:35:25.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"AI-WAIFU","name":null,"path":"/AI-WAIFU","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/67525070?s=80&v=4"},"commit":{"message":"add more informative checks for ZeRO incompatibility, fix is_pipe_parallel check","shortMessageHtmlLink":"add more informative checks for ZeRO incompatibility, fix is_pipe_par…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xOVQwMDo1ODo1NS4wMDAwMDBazwAAAAS6SufW","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xOVQwMDo1ODo1NS4wMDAwMDBazwAAAAS6SufW","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0wOVQxNjozNToyNS4wMDAwMDBazwAAAASxInV2"}},"title":"Activity · EleutherAI/gpt-neox"}