{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":212488700,"defaultBranch":"master","name":"serve","ownerLogin":"pytorch","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2019-10-03T03:17:43.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/21003710?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726769822.0","currentOid":""},"activityList":{"items":[{"before":"385ed7adcfaa327e35da63fa1b8a7524b440d5b7","after":"a45eb7c1ea91d2afc2e80bd71bb45c77f91f1aa2","ref":"refs/heads/docker_aarch","pushedAt":"2024-09-19T22:30:03.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"Merge branch 'master' into docker_aarch","shortMessageHtmlLink":"Merge branch 'master' into docker_aarch"}},{"before":"b2c917c218ed19bdcada3f9196e69e08e842a767","after":"385ed7adcfaa327e35da63fa1b8a7524b440d5b7","ref":"refs/heads/docker_aarch","pushedAt":"2024-09-19T22:27:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"changing nightly push","shortMessageHtmlLink":"changing nightly push"}},{"before":null,"after":"b2c917c218ed19bdcada3f9196e69e08e842a767","ref":"refs/heads/docker_aarch","pushedAt":"2024-09-19T18:17:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"Merge branch 'master' into docker_aarch","shortMessageHtmlLink":"Merge branch 'master' into docker_aarch"}},{"before":"c943c5e9ecebd65bced80275985864cf3a26c1e1","after":"e2bec9a7c9a7d4d78713642be4fbab92359ca562","ref":"refs/heads/snap_fix","pushedAt":"2024-09-18T18:30:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"testing newer docker","shortMessageHtmlLink":"testing newer docker"}},{"before":"e212294906861f80b88b70d05da59b095fb2c445","after":null,"ref":"refs/heads/gh-readonly-queue/master/pr-3315-c6dde82aa56ac50b2ed874ac7bc98a420b207d93","pushedAt":"2024-09-18T14:47:20.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"c6dde82aa56ac50b2ed874ac7bc98a420b207d93","after":"e212294906861f80b88b70d05da59b095fb2c445","ref":"refs/heads/master","pushedAt":"2024-09-18T14:47:19.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Use startup time in async worker thread instead of worker timeout (#3315)\n\n* Use startup time in async worker thread instead of worker timeout\n\n* Fix lint\n\n* Update yaml files to use startupTimeout\n\n* Update vllm/lora readme","shortMessageHtmlLink":"Use startup time in async worker thread instead of worker timeout (#3315"}},{"before":null,"after":"e212294906861f80b88b70d05da59b095fb2c445","ref":"refs/heads/gh-readonly-queue/master/pr-3315-c6dde82aa56ac50b2ed874ac7bc98a420b207d93","pushedAt":"2024-09-18T14:11:05.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Use startup time in async worker thread instead of worker timeout (#3315)\n\n* Use startup time in async worker thread instead of worker timeout\n\n* Fix lint\n\n* Update yaml files to use startupTimeout\n\n* Update vllm/lora readme","shortMessageHtmlLink":"Use startup time in async worker thread instead of worker timeout (#3315"}},{"before":"0a13ab0b374419f239ee49b0e2ab14642419cc1a","after":"e1f00f69e544ffd03c3840e7eec2bc938bf8efec","ref":"refs/heads/fix/startuptime_in_async_thread","pushedAt":"2024-09-18T01:08:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Update vllm/lora readme","shortMessageHtmlLink":"Update vllm/lora readme"}},{"before":"f6a6d9d64bbc41b6fd3397bbfb0d3499ee408e02","after":"0a13ab0b374419f239ee49b0e2ab14642419cc1a","ref":"refs/heads/fix/startuptime_in_async_thread","pushedAt":"2024-09-18T00:49:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Update yaml files to use startupTimeout","shortMessageHtmlLink":"Update yaml files to use startupTimeout"}},{"before":"41e1d65bc5e37f5975fc6d7b827df03a75412d5d","after":"c943c5e9ecebd65bced80275985864cf3a26c1e1","ref":"refs/heads/snap_fix","pushedAt":"2024-09-18T00:47:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"testing adding default","shortMessageHtmlLink":"testing adding default"}},{"before":"79f0e41be896bd3a8bc947b68fa90a7db87133a5","after":"f6a6d9d64bbc41b6fd3397bbfb0d3499ee408e02","ref":"refs/heads/fix/startuptime_in_async_thread","pushedAt":"2024-09-18T00:35:47.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Merge branch 'master' into fix/startuptime_in_async_thread","shortMessageHtmlLink":"Merge branch 'master' into fix/startuptime_in_async_thread"}},{"before":"814a5182e191de05e3b425ee3004db271d0870fa","after":"79f0e41be896bd3a8bc947b68fa90a7db87133a5","ref":"refs/heads/fix/startuptime_in_async_thread","pushedAt":"2024-09-18T00:35:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Fix lint","shortMessageHtmlLink":"Fix lint"}},{"before":"d5e10de27120144fb9b8cb0a9ad87107839fd462","after":"41e1d65bc5e37f5975fc6d7b827df03a75412d5d","ref":"refs/heads/snap_fix","pushedAt":"2024-09-18T00:18:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"testing adding startup","shortMessageHtmlLink":"testing adding startup"}},{"before":"fe509310019f131e2f1ff2306973fc631c78cbd8","after":null,"ref":"refs/heads/dependabot/pip/examples/large_models/vllm/vllm-0.5.5","pushedAt":"2024-09-17T23:54:41.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":"c6dde82aa56ac50b2ed874ac7bc98a420b207d93","after":null,"ref":"refs/heads/gh-readonly-queue/master/pr-3321-d5e10de27120144fb9b8cb0a9ad87107839fd462","pushedAt":"2024-09-17T23:54:34.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"d5e10de27120144fb9b8cb0a9ad87107839fd462","after":"c6dde82aa56ac50b2ed874ac7bc98a420b207d93","ref":"refs/heads/master","pushedAt":"2024-09-17T23:54:33.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm (#3321)\n\n* Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm\n\nBumps [vllm](https://github.com/vllm-project/vllm) from 0.5.0 to 0.5.5.\n- [Release notes](https://github.com/vllm-project/vllm/releases)\n- [Commits](https://github.com/vllm-project/vllm/compare/v0.5.0...v0.5.5)\n\n---\nupdated-dependencies:\n- dependency-name: vllm\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] \n\n* Update examples/large_models/vllm/requirements.txt\r\n\r\nUpdate vllm dependency to match PT version\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>","shortMessageHtmlLink":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm (#3321)"}},{"before":null,"after":"d5e10de27120144fb9b8cb0a9ad87107839fd462","ref":"refs/heads/snap_fix","pushedAt":"2024-09-17T23:48:00.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"},"commit":{"message":"TRT LLM Integration with LORA (#3305)\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* Added launcher support for trt_llm\n\n* updated README\n\n* updated README\n\n* Using the API that supports async generate\n\n* Review comments\n\n* Apply suggestions from code review\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>\n\n* addressed review comments\n\n* Addressed review comments\n\n* Updated the async logic based on review comments\n\n* Made max_batch_size and kv_cache size configurable for the launcher\n\n* fixing lint\n\n---------\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>","shortMessageHtmlLink":"TRT LLM Integration with LORA (#3305)"}},{"before":"b2c917c218ed19bdcada3f9196e69e08e842a767","after":null,"ref":"refs/heads/docker_aarch","pushedAt":"2024-09-17T23:47:48.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"}},{"before":"e2c6ef07cf98492e48061a175fb537c3bf38f2a3","after":null,"ref":"refs/heads/graviton_test","pushedAt":"2024-09-17T23:47:46.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"udaij12","name":null,"path":"/udaij12","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/32673964?s=80&v=4"}},{"before":"1a41f98d405b998450d464b721cb1dfb45ae8dbb","after":"814a5182e191de05e3b425ee3004db271d0870fa","ref":"refs/heads/fix/startuptime_in_async_thread","pushedAt":"2024-09-17T23:25:30.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Merge branch 'master' into fix/startuptime_in_async_thread","shortMessageHtmlLink":"Merge branch 'master' into fix/startuptime_in_async_thread"}},{"before":null,"after":"c6dde82aa56ac50b2ed874ac7bc98a420b207d93","ref":"refs/heads/gh-readonly-queue/master/pr-3321-d5e10de27120144fb9b8cb0a9ad87107839fd462","pushedAt":"2024-09-17T23:17:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm (#3321)\n\n* Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm\n\nBumps [vllm](https://github.com/vllm-project/vllm) from 0.5.0 to 0.5.5.\n- [Release notes](https://github.com/vllm-project/vllm/releases)\n- [Commits](https://github.com/vllm-project/vllm/compare/v0.5.0...v0.5.5)\n\n---\nupdated-dependencies:\n- dependency-name: vllm\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] \n\n* Update examples/large_models/vllm/requirements.txt\r\n\r\nUpdate vllm dependency to match PT version\n\n---------\n\nSigned-off-by: dependabot[bot] \nCo-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>","shortMessageHtmlLink":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm (#3321)"}},{"before":"d5e10de27120144fb9b8cb0a9ad87107839fd462","after":null,"ref":"refs/heads/gh-readonly-queue/master/pr-3305-2dfbff73eae08197083f8d84c62b12ce5e0dd440","pushedAt":"2024-09-17T23:14:59.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"2dfbff73eae08197083f8d84c62b12ce5e0dd440","after":"d5e10de27120144fb9b8cb0a9ad87107839fd462","ref":"refs/heads/master","pushedAt":"2024-09-17T23:14:58.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"TRT LLM Integration with LORA (#3305)\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* Added launcher support for trt_llm\n\n* updated README\n\n* updated README\n\n* Using the API that supports async generate\n\n* Review comments\n\n* Apply suggestions from code review\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>\n\n* addressed review comments\n\n* Addressed review comments\n\n* Updated the async logic based on review comments\n\n* Made max_batch_size and kv_cache size configurable for the launcher\n\n* fixing lint\n\n---------\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>","shortMessageHtmlLink":"TRT LLM Integration with LORA (#3305)"}},{"before":"3bad4201b01d4322b8e1ef1cdbb2b9d3780490c9","after":"fe509310019f131e2f1ff2306973fc631c78cbd8","ref":"refs/heads/dependabot/pip/examples/large_models/vllm/vllm-0.5.5","pushedAt":"2024-09-17T22:41:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"mreso","name":"Matthias Reso","path":"/mreso","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13337103?s=80&v=4"},"commit":{"message":"Update examples/large_models/vllm/requirements.txt\r\n\r\nUpdate vllm dependency to match PT version","shortMessageHtmlLink":"Update examples/large_models/vllm/requirements.txt"}},{"before":null,"after":"d5e10de27120144fb9b8cb0a9ad87107839fd462","ref":"refs/heads/gh-readonly-queue/master/pr-3305-2dfbff73eae08197083f8d84c62b12ce5e0dd440","pushedAt":"2024-09-17T22:39:44.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"TRT LLM Integration with LORA (#3305)\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* TRT LLM Integration with LORA\n\n* Added launcher support for trt_llm\n\n* updated README\n\n* updated README\n\n* Using the API that supports async generate\n\n* Review comments\n\n* Apply suggestions from code review\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>\n\n* addressed review comments\n\n* Addressed review comments\n\n* Updated the async logic based on review comments\n\n* Made max_batch_size and kv_cache size configurable for the launcher\n\n* fixing lint\n\n---------\n\nCo-authored-by: Matthias Reso <13337103+mreso@users.noreply.github.com>","shortMessageHtmlLink":"TRT LLM Integration with LORA (#3305)"}},{"before":null,"after":"3bad4201b01d4322b8e1ef1cdbb2b9d3780490c9","ref":"refs/heads/dependabot/pip/examples/large_models/vllm/vllm-0.5.5","pushedAt":"2024-09-17T21:34:43.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm\n\nBumps [vllm](https://github.com/vllm-project/vllm) from 0.5.0 to 0.5.5.\n- [Release notes](https://github.com/vllm-project/vllm/releases)\n- [Commits](https://github.com/vllm-project/vllm/compare/v0.5.0...v0.5.5)\n\n---\nupdated-dependencies:\n- dependency-name: vllm\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm"}},{"before":"82606197510869ac131241d11c2e31c3caa6eca8","after":"589130d3eb65ad5ce899a97017bfa30fdfed726e","ref":"refs/heads/feature/trt_llm_lora","pushedAt":"2024-09-17T20:53:23.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"agunapal","name":"Ankith Gunapal","path":"/agunapal","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16617092?s=80&v=4"},"commit":{"message":"Merge branch 'master' into feature/trt_llm_lora","shortMessageHtmlLink":"Merge branch 'master' into feature/trt_llm_lora"}},{"before":"26a1532aca7bc7a169caa0d0585b8fdd666c984c","after":"82606197510869ac131241d11c2e31c3caa6eca8","ref":"refs/heads/feature/trt_llm_lora","pushedAt":"2024-09-17T20:48:06.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"agunapal","name":"Ankith Gunapal","path":"/agunapal","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/16617092?s=80&v=4"},"commit":{"message":"fixing lint","shortMessageHtmlLink":"fixing lint"}},{"before":"2dfbff73eae08197083f8d84c62b12ce5e0dd440","after":null,"ref":"refs/heads/gh-readonly-queue/master/pr-3319-ba8c268fe09cb9396749a9ae5d480ba252764d71","pushedAt":"2024-09-17T19:48:50.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"}},{"before":"ba8c268fe09cb9396749a9ae5d480ba252764d71","after":"2dfbff73eae08197083f8d84c62b12ce5e0dd440","ref":"refs/heads/master","pushedAt":"2024-09-17T19:48:49.000Z","pushType":"merge_queue_merge","commitsCount":1,"pusher":{"login":"github-merge-queue[bot]","name":null,"path":"/apps/github-merge-queue","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9919?s=80&v=4"},"commit":{"message":"Fixing kserve nightly for arm64 (#3319)\n\n* adding graviton docker image\n\n* testing multiplatform ci\n\n* testing multiplatform ci\n\n* testing multiplatform ci\n\n* adding new builder\n\n* removing arm\n\n* removing arm\n\n* testing arm\n\n* tests\n\n* testing driver command\n\n* testing driver command\n\n* testing on newer instance\n\n* testing on newer instance\n\n* testing newer\n\n* rm command\n\n* changing platform\n\n* testing only amd\n\n* testing both arch\n\n* testing both arch\n\n* testing both\n\n* remove builder\n\n* remove builder\n\n* adding amd\n\n* building cache\n\n* cache 3\n\n* cache 4\n\n* cache 4\n\n* final test\n\n* reverting temp changes\n\n* testing official release\n\n* testing official release\n\n* testing official release\n\n* adding kserve changes\n\n* kserve nightly\n\n* adding build context\n\n---------\n\nCo-authored-by: Ankith Gunapal ","shortMessageHtmlLink":"Fixing kserve nightly for arm64 (#3319)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEu19d4AA","startCursor":null,"endCursor":null}},"title":"Activity ยท pytorch/serve"}