{"id":12329,"date":"2025-09-11T15:08:25","date_gmt":"2025-09-11T07:08:25","guid":{"rendered":"https:\/\/ai-stack.ai\/?p=12329"},"modified":"2026-03-11T17:10:40","modified_gmt":"2026-03-11T09:10:40","slug":"how-to-use-horovod-on-aistack","status":"publish","type":"post","link":"https:\/\/ai-stack.ai\/ko\/how-to-use-horovod-on-aistack","title":{"rendered":"\uac15\uc758: AI-Stack\uc5d0\uc11c Horovod \ubc0f DeepSpeed\ub97c \ud65c\uc6a9\ud55c \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828 \ubc29\ubc95"},"content":{"rendered":"\n

\ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828(Elastic Distributed Training)\uc740 AI \ubaa8\ub378 \ud6c8\ub828\uc5d0\uc11c \ud6a8\uc728\uc131\uacfc \uc720\uc5f0\uc131\uc744 \ub192\uc774\uae30 \uc704\ud574 \uc0ac\uc6a9\ub418\ub294 \uae30\uc220\uc785\ub2c8\ub2e4. \uac04\ub2e8\ud788 \ub9d0\ud574, \ubaa8\ub378 \ud6c8\ub828\uc774 \ub2e8\uc77c \uba38\uc2e0\uc774\ub098 \uace0\uc815\ub41c \uc218\uc758 \ucee8\ud14c\uc774\ub108\uc5d0 \uad6d\ud55c\ub418\uc9c0 \uc54a\uace0 \uc218\uc694\uc5d0 \ub530\ub77c \uac00\uc6a9\ud55c \ucef4\ud4e8\ud305 \uc790\uc6d0\uc744 \ub3d9\uc801\uc73c\ub85c \uc870\uc815\ud558\uace0 \ud65c\uc6a9\ud560 \uc218 \uc788\uac8c \ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

\uc778\ud53c\ub2c8\ud2f1\uc2a4\ub294 \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828\uc744 AI-Stack\uc5d0 \uc6d0\ud65c\ud558\uac8c \ud1b5\ud569\ud558\uc5ec Horovod<\/a>, DeepSpeed<\/a>, Megatron-LM, Slurm \ub4f1 \uc8fc\uc694 \ud504\ub808\uc784\uc6cc\ud06c\ub97c \uc9c0\uc6d0\ud568\uc73c\ub85c\uc368 \uae30\uc5c5\uc758 \uc790\uc6d0 \uc2a4\ucf00\uc904\ub9c1 \ubcd1\ubaa9 \ud604\uc0c1\uc744 \ud6a8\uacfc\uc801\uc73c\ub85c \ud574\uc18c\ud558\uace0 \ub300\uaddc\ubaa8 AI \ubaa8\ub378 \ud6c8\ub828\uc744 \uac00\uc18d\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

\ubcf8 \uae00\uc5d0\uc11c\ub294 AI-Stack\uc5d0\uc11c Horovod\ub97c \ud65c\uc6a9\ud574 \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828\uc744 \uc218\ud589\ud558\ub294 \ubc29\ubc95\uc744 \ub2e8\uacc4\ubcc4\ub85c \uc2dc\uc5f0\ud574 \ub4dc\ub9ac\uaca0\uc2b5\ub2c8\ub2e4!<\/p>\n\n\n\n

Horovod\uc640 DeepSpeed\uc758 \uc6b4\uc601 \ub2e8\uacc4\uac00 \uc720\uc0ac\ud558\ubbc0\ub85c, \ubcf8 \uae00\uc5d0\uc11c\ub294 Horovod\ub97c \uc608\uc2dc\ub85c \uc0ac\uc6a9\ud569\ub2c8\ub2e4. \uc8fc\uc758\ud560 \uc810\uc740 \uc0ac\uc6a9 \uc804 \u3010\uacf5\uc6a9 \uc774\ubbf8\uc9c0 \ubaa9\ub85d\u3011\uc5d0 DeepSpeed \ubc0f Horovod \ud504\ub808\uc784\uc6cc\ud06c \uc2e4\ud589\uc5d0 \uc801\ud569\ud55c \uc774\ubbf8\uc9c0\uac00 \uc900\ube44\ub418\uc5b4 \uc788\ub294\uc9c0 \ud655\uc778\ud574\uc57c \ud55c\ub2e4\ub294 \uac83\uc785\ub2c8\ub2e4.<\/p>\n\n\n\n

Horovod \ubd84\uc0b0 \ud6c8\ub828<\/strong><\/h2>\n\n\n\n

\uba3c\uc800, AI-Stack \uc0ac\uc6a9\uc790 \uc778\ud130\ud398\uc774\uc2a4\uc5d0 \ub85c\uadf8\uc778\ud55c \ud6c4 \u2018\ucee8\ud14c\uc774\ub108 \uad00\ub9ac\u2019\ub85c \uc774\ub3d9\ud558\uc5ec ‘\ubd84\uc0b0 \ud6c8\ub828 \ud074\ub7ec\uc2a4\ud130\u2019\ub97c \uc120\ud0dd\ud569\ub2c8\ub2e4. \uadf8\ub7f0 \ub2e4\uc74c ‘\ud074\ub7ec\uc2a4\ud130 \uc0dd\uc131\u2019 \ubc84\ud2bc\uc744 \ud074\ub9ad\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

\uc0dd\uc131 \ud398\uc774\uc9c0\uc5d0\uc11c Horovod\ub97c \uc120\ud0dd\ud558\uace0 \ud074\ub7ec\uc2a4\ud130 \uc774\ub984\uc744 \uc785\ub825\ud569\ub2c8\ub2e4. \uc5ec\uae30\uc11c\ub294 \ub370\ubaa8\ub97c \uc704\ud574 tthvd\ub97c \uc785\ub825\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\ub2e4\uc74c\uc73c\ub85c \uc6d0\ud558\ub294 \ucee8\ud14c\uc774\ub108 \uc218\ub97c \uc124\uc815\ud569\ub2c8\ub2e4. \uc5ec\uae30\uc11c\ub294 \uba3c\uc800 2\uac1c\ub97c \uc785\ub825\ud558\uace0 \ud544\uc694\ud55c \uc774\ubbf8\uc9c0\ub97c \uc120\ud0dd\ud560 \uac83\uc785\ub2c8\ub2e4. \uc5ec\uae30\uc11c \ub450 \uac00\uc9c0 \uc0ac\ud56d\uc5d0 \uc720\uc758\ud574\uc57c \ud569\ub2c8\ub2e4:<\/p>\n\n\n\n

    \n
  • \ucee8\ud14c\uc774\ub108 \uc218\ub294 2\uac1c \uc774\uc0c1\uc774\uc5b4\uc57c \ud558\uba70, \uc5ec\uae30\uc5d0\ub294 \ub7f0\ucc98 \ucee8\ud14c\uc774\ub108 1\uac1c\uc640 \ub098\uba38\uc9c0 \uc6cc\ucee4 \ucee8\ud14c\uc774\ub108\uac00 \ud3ec\ud568\ub429\ub2c8\ub2e4.<\/li>\n\n\n\n
  • \ud074\ub7ec\uc2a4\ud130 \uc720\ud615\uc5d0 \ub530\ub77c \ud6c8\ub828 \ud504\ub808\uc784\uc6cc\ud06c\uac00 \ud3ec\ud568\ub41c \uc774\ubbf8\uc9c0\ub97c \uc120\ud0dd\ud574\uc57c \ud569\ub2c8\ub2e4.<\/li>\n<\/ul>\n\n\n\n
    \"\"<\/figure>\n\n\n\n

    \ub2e4\uc74c\uc73c\ub85c \u300cGPU \ud65c\uc131\ud654\u300d\ub97c \uc120\ud0dd\ud558\uba74 \uac01 \ucee8\ud14c\uc774\ub108\uc5d0 \uc9c0\uc815\ub41c GPU \uc0ac\uc591\uc744 \uc120\ud0dd\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc5ec\uae30\uc11c\ub294 \uac01 \ucee8\ud14c\uc774\ub108\uc5d0 NVIDIA-P4 GPU 1\uac1c\ub97c \ud560\ub2f9\ud558\ub294 \ub9ac\uc18c\uc2a4\ub97c \uc120\ud0dd\ud569\ub2c8\ub2e4. \ub610\ud55c \uacf5\uc720 \uba54\ubaa8\ub9ac \ud65c\uc131\ud654 \uc5ec\ubd80\ub97c \uc120\ud0dd\ud558\uace0 \ud544\uc694\ud55c \uc6a9\ub7c9\uc744 \uc785\ub825\ud560 \uc218\ub3c4 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \ub2e4\uc74c\uc73c\ub85c \ub9c8\uc6b4\ud2b8\ud560 \uc800\uc7a5 \uc7a5\uce58\ub97c \uc120\ud0dd\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    1~2\ubd84 \uc815\ub3c4 \uae30\ub2e4\ub9ac\uba74 \ub450 \uac1c\uc758 \ucee8\ud14c\uc774\ub108\uac00 \uc0dd\uc131\ub418\uc5b4 \u201cRunning\u201d \uc0c1\ud0dc\ub85c \ud45c\uc2dc\ub418\uba70, \uac01\uac01 NVIDIA-P4 GPU \ub9ac\uc18c\uc2a4\ub97c \ud558\ub098\uc529 \ud560\ub2f9\ubc1b\uac8c \ub429\ub2c8\ub2e4.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \ud074\ub7ec\uc2a4\ud130 \uc900\ube44\uac00 \uc644\ub8cc\ub418\uba74 \uc11c\ube44\uc2a4\uc5d0\uc11c SSH \ub610\ub294 \ub354 \ud3b8\ub9ac\ud55c JupyterLab \ubc29\uc2dd\uc73c\ub85c \uc5f0\uacb0\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc5ec\uae30\uc11c\ub294 \ub354 \uac04\ub2e8\ud55c JupyterLab\uc744 \uc120\ud0dd\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    JupyterLab\uc5d0\uc11c \ud130\ubbf8\ub110\uc744 \uc120\ud0dd\ud569\ub2c8\ub2e4(SSH \uc5f0\uacb0\uacfc \ub3d9\uc77c\ud55c \uc758\ubbf8).<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \ud648\uc73c\ub85c \ub3cc\uc544\uac00\uba74 \uc678\ubd80 \uc2a4\ud1a0\ub9ac\uc9c0 \ud074\ub7ec\uc2a4\ud130\uc5d0\uc11c \ub9c8\uc6b4\ud2b8\ud55c \ub514\uc2a4\ud06c \uc601\uc5ed\uc744 \ud655\uc778\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc6b0\ub9ac\ub294 \ubbf8\ub9ac horovod \ud14c\uc2a4\ud2b8 \ud504\ub85c\uadf8\ub7a8\uc744 \uc124\uce58\ud574 \ub450\uc5c8\uc73c\ubbc0\ub85c, \uc774\ub97c \uc9c1\uc811 \uc2e4\ud589\ud558\uc5ec \uc0ac\uc6a9\ud558\ub294 \ubc29\ubc95\uc744 \uc2dc\uc5f0\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n

    \"\"<\/figure>\n\n\n\n

    \ub2e4\uc74c\uc73c\ub85c, \ud6c8\ub828 \uc2a4\ud06c\ub9bd\ud2b8\ub97c \uc2e4\ud589\ud558\uae30 \uc704\ud55c \uba85\ub839\uc5b4\ub97c \uc785\ub825\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n

    horovodrun -np 2 \u2013hostfile \/etc\/mpi\/hostfile python tensorflow2_mist.py<\/p>\n\n\n\n

      \n
    • -np 2: \u2013num-processes\uc758 \uc57d\uc790\ub85c, \uc2e4\ud589\ud560 Python \ud504\ub85c\uc138\uc2a4 \uc218\ub97c \uc9c0\uc815\ud569\ub2c8\ub2e4. \uc5ec\uae30\uc11c 2\ub97c \uc785\ub825\ud558\uba74 \ub450 \uac1c\uc758 \ucee8\ud14c\uc774\ub108 \ub9ac\uc18c\uc2a4\ub97c \ud65c\uc6a9\ud574 \ubd84\uc0b0 \ucef4\ud4e8\ud305\uc744 \uc218\ud589\ud569\ub2c8\ub2e4.<\/li>\n\n\n\n
    • \u2013hostfile \/etc\/mpi\/hostfile: hostfile\uc740 \uc774 \ubd84\uc0b0 \ud074\ub7ec\uc2a4\ud130\uc5d0\uc11c \uc0ac\uc6a9 \uac00\ub2a5\ud55c \ucee8\ud14c\uc774\ub108\uc640 \uac01 \ucee8\ud14c\uc774\ub108\uc758 GPU \uce74\ub4dc \uc218\ub97c \uc124\uba85\ud569\ub2c8\ub2e4. AI-Stack\uc774 \uc790\ub3d9\uc73c\ub85c \uc0dd\uc131 \ubc0f \uc720\uc9c0 \uad00\ub9ac\ud558\ub294 \ud30c\uc77c\uc785\ub2c8\ub2e4. \u2013hostfile \ub9e4\uac1c\ubcc0\uc218\ub294 horovod\uac00 hostfile \ud30c\uc77c\uc744 \uc77d\uc744 \uc704\uce58\ub97c \uc54c\ub824\uc8fc\uc5b4, horovod\uac00 \ud30c\uc77c \ub0b4 \uc124\uba85\uc5d0 \ub530\ub77c GPU \ub9ac\uc18c\uc2a4\ub97c \ud638\ucd9c\ud560 \uc218 \uc788\uac8c \ud569\ub2c8\ub2e4.<\/li>\n\n\n\n
    • python tensorflow2_mnist.py\ub294 \uc2e4\ud589\ud560 \uc2a4\ud06c\ub9bd\ud2b8\uc785\ub2c8\ub2e4.<\/li>\n<\/ul>\n\n\n\n
      \"\"<\/figure>\n\n\n\n

      \uc6b0\ub9ac\uc758 \ud6c8\ub828 \uc2a4\ud06c\ub9bd\ud2b8\uc5d0\ub294 \ucd1d \ub9cc \uac1c\uc758 \ub370\uc774\ud130\uac00 \uc788\uc73c\uba70, \uc774 \ub370\uc774\ud130\ub294 2\uac1c\uc758 \ucee8\ud14c\uc774\ub108\uc5d0 \ubd84\ubc30\ub418\uc5c8\uc2b5\ub2c8\ub2e4. \ud55c \ucee8\ud14c\uc774\ub108\uc5d0\ub294 5\ucc9c \uac1c\uc758 \ub370\uc774\ud130\uac00 \ud560\ub2f9\ub418\uc5b4 \ud6c8\ub828\uc744 \uc218\ud589\ud558\uace0 \uc788\uc74c\uc744 \ud655\uc778\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n","protected":false},"excerpt":{"rendered":"

      \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828(Elastic Distributed Training)\uc740 AI \ubaa8\ub378 \ud6c8\ub828\uc5d0\uc11c \ud6a8\uc728\uc131\uacfc \uc720\uc5f0\uc131\uc744 \ub192\uc774\uae30 \uc704\ud574 \uc0ac\uc6a9\ub418\ub294 \uae30\uc220\uc785\ub2c8\ub2e4. \uac04\ub2e8\ud788 \ub9d0\ud574, \ubaa8\ub378 \ud6c8\ub828\uc774 \ub2e8\uc77c \uba38\uc2e0\uc774\ub098 \uace0\uc815\ub41c \uc218\uc758 \ucee8\ud14c\uc774\ub108\uc5d0 \uad6d\ud55c\ub418\uc9c0 \uc54a\uace0 \uc218\uc694\uc5d0 \ub530\ub77c \uac00\uc6a9\ud55c \ucef4\ud4e8\ud305 \uc790\uc6d0\uc744 \ub3d9\uc801\uc73c\ub85c \uc870\uc815\ud558\uace0 \ud65c\uc6a9\ud560 \uc218 \uc788\uac8c \ud569\ub2c8\ub2e4. \uc778\ud53c\ub2c8\ud2f1\uc2a4\ub294 \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828\uc744 AI-Stack\uc5d0 \uc6d0\ud65c\ud558\uac8c \ud1b5\ud569\ud558\uc5ec Horovod, DeepSpeed, Megatron-LM, Slurm \ub4f1 \uc8fc\uc694 \ud504\ub808\uc784\uc6cc\ud06c\ub97c \uc9c0\uc6d0\ud568\uc73c\ub85c\uc368 \uae30\uc5c5\uc758 \uc790\uc6d0 \uc2a4\ucf00\uc904\ub9c1 \ubcd1\ubaa9 \ud604\uc0c1\uc744 \ud6a8\uacfc\uc801\uc73c\ub85c \ud574\uc18c\ud558\uace0 \ub300\uaddc\ubaa8 AI \ubaa8\ub378 \ud6c8\ub828\uc744 \uac00\uc18d\ud569\ub2c8\ub2e4. \ubcf8 \uae00\uc5d0\uc11c\ub294 AI-Stack\uc5d0\uc11c Horovod\ub97c \ud65c\uc6a9\ud574 \ud0c4\ub825\uc801 \ubd84\uc0b0 \ud6c8\ub828\uc744 \uc218\ud589\ud558\ub294 \ubc29\ubc95\uc744 \ub2e8\uacc4\ubcc4\ub85c \uc2dc\uc5f0\ud574 \ub4dc\ub9ac\uaca0\uc2b5\ub2c8\ub2e4! Horovod\uc640 DeepSpeed\uc758 \uc6b4\uc601 \ub2e8\uacc4\uac00 \uc720\uc0ac\ud558\ubbc0\ub85c, \ubcf8 \uae00\uc5d0\uc11c\ub294 Horovod\ub97c \uc608\uc2dc\ub85c \uc0ac\uc6a9\ud569\ub2c8\ub2e4. \uc8fc\uc758\ud560 \uc810\uc740 \uc0ac\uc6a9 \uc804 \u3010\uacf5\uc6a9 \uc774\ubbf8\uc9c0 \ubaa9\ub85d\u3011\uc5d0 DeepSpeed \ubc0f Horovod \ud504\ub808\uc784\uc6cc\ud06c \uc2e4\ud589\uc5d0 \uc801\ud569\ud55c \uc774\ubbf8\uc9c0\uac00 \uc900\ube44\ub418\uc5b4…<\/p>\n","protected":false},"author":253372388,"featured_media":12499,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_crdt_document":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[96988277],"tags":[96988370,96988406,96988407,96988408],"class_list":["post-12329","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technical-support","tag-hpc","tag-ai-stack-","tag-96988407","tag-horovod"],"blocksy_meta":[],"acf":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ai-stack.ai\/wp-content\/uploads\/2025\/09\/Blog%E6%8A%80%E8%A1%93%E6%94%AF%E6%8F%B41-fd6a7458.jpg?fit=1920%2C1080&quality=100&ct=202603031250&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/ph344V-3cR","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/posts\/12329","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/users\/253372388"}],"replies":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/comments?post=12329"}],"version-history":[{"count":3,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/posts\/12329\/revisions"}],"predecessor-version":[{"id":12619,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/posts\/12329\/revisions\/12619"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/media\/12499"}],"wp:attachment":[{"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/media?parent=12329"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/categories?post=12329"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ai-stack.ai\/ko\/wp-json\/wp\/v2\/tags?post=12329"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}