{"id":15616,"date":"2025-08-15T14:37:07","date_gmt":"2025-08-15T06:37:07","guid":{"rendered":"https:\/\/slash.co\/?post_type=resources&p=15616"},"modified":"2025-08-15T14:37:07","modified_gmt":"2025-08-15T06:37:07","slug":"testing-openais-latest-gpt-oss-20b-model-on-my-local-machine","status":"publish","type":"resources","link":"https:\/\/slash.co\/articles\/testing-openais-latest-gpt-oss-20b-model-on-my-local-machine\/","title":{"rendered":"Testing OpenAI\u2019s Latest gpt-oss 20b Model on My Local Machine"},"content":{"rendered":"

OpenAI has recently made a significant move by releasing its first open-weight models since pioneering GPT-2. This release includes two distinct models: gpt-oss-120B and gpt-oss-20B, both of which are made available under the permissive Apache 2.0 license.<\/span><\/p>\n

The strategic decision to release these models under the Apache 2.0 license underscores OpenAI’s commitment to fostering a collaborative and innovative AI ecosystem. This open-weight approach is explicitly aimed at accelerating global AI innovation, allowing a wider community to contribute to, improve upon, and benefit from these powerful new tools.\u00a0<\/span><\/p>\n

My laptop specs:<\/b><\/h3>\n

Model: Macbook Pro M4 Pro<\/span><\/p>\n

CPU: 14-core (10 performance and 4 efficiency)<\/span><\/p>\n

GPU: 20-core<\/span><\/p>\n

RAM: 24GB<\/span><\/p>\n

 <\/p>\n

Here is my experiment prompts to test gpt-oss 20b:<\/span><\/p>\n

1. Reasoning & Logic<\/b><\/h2>\n

Test for the model\u2019s ability to follow complex logical steps.<\/span><\/p>\n

    \n
  • Prompt:<\/b>
    \n<\/b> \u201cIf five painters can paint five houses in five days, how many houses can ten painters paint in ten days, assuming equal productivity?\u201d<\/span><\/i><\/p>\n

    <\/span><\/i><\/li>\n

  • Why:<\/b> Checks reasoning, proportional scaling, and math.<\/span><\/li>\n
  • Response<\/b> (gpt-oss 20b):\u00a0<\/span><\/li>\n<\/ul>\n

    Each<\/span> painter<\/span> finishes<\/span> one<\/span> house<\/span> in<\/span> 5<\/span> days<\/span> \u2192\u202f(<\/span> (<\/span>1<\/span>)\/(<\/span>5<\/span>))<\/span> house<\/span> per<\/span> day.<\/span><\/p>\n

    Ten<\/span> painters<\/span> paint<\/span> (<\/span>10<\/span> \u00d7<\/span> (<\/span>1<\/span>)\/(<\/span>5<\/span>)<\/span> =<\/span> 2<\/span>)<\/span> houses<\/span> each<\/span> day.<\/span><\/p>\n

    In<\/span> 10<\/span> days:<\/span> (<\/span>2<\/span> \u00d7<\/span> 10<\/span> =<\/span> 20<\/span>)<\/span> houses.<\/span><\/p>\n

    \u23f1\ufe0f<\/span> Response<\/span> completed<\/span> in<\/span> 22<\/span>.<\/span>89<\/span> seconds<\/span><\/p>\n

    2. Common Sense & Real-World Knowledge<\/b><\/h2>\n

    Evaluate if it understands everyday scenarios.<\/span><\/p>\n

      \n
    • Prompt:<\/b>
      \n<\/b> \u201cWhy do we put ice in a drink, and what happens to the drink over time?\u201d<\/span><\/i><\/p>\n

      <\/span><\/i><\/li>\n

    • Why:<\/b> Tests practical knowledge without needing specialized facts.<\/span><\/li>\n
    • Response<\/b> (gpt-oss 20b): <\/span>\n

      <\/span><\/li>\n<\/ul>\n

      scientific repsonse blah blah…\u00a0<\/span><\/p>\n

       <\/p>\n

      Ice<\/span> cools<\/span> the<\/span> drink,<\/span> keeps<\/span> it<\/span> fresher,<\/span> and<\/span> slightly<\/span> dilutes<\/span> it.<\/span> Over<\/span> time<\/span> the<\/span> ice<\/span> melts,<\/span> the<\/span> drink<\/span> becomes<\/span> colder,<\/span> more<\/span> diluted,<\/span> and<\/span> eventually<\/span> reaches<\/span> the<\/span> temperature<\/span> of<\/span> its<\/span> environment.<\/span><\/p>\n

       <\/p>\n

      \u23f1\ufe0f<\/span><\/i> Response<\/span><\/i> completed<\/span><\/i> in<\/span><\/i> 40<\/span><\/i>.<\/span><\/i>26<\/span><\/i> seconds<\/span><\/i><\/p>\n

       <\/p>\n

      3. Multi-Step Instruction Following<\/b><\/h2>\n

      See if it can follow a sequence of constraints.<\/span><\/p>\n

        \n
      • Prompt:<\/b>
        \n<\/b> \u201cWrite a three-sentence story about a cat who learns to dance. In the first sentence, introduce the cat\u2019s name. In the second, mention a city. In the third, end with the word \u2018finally.\u2019\u201d<\/span><\/i><\/p>\n

        <\/span><\/i><\/li>\n

      • Why:<\/b> Evaluates instruction-following precision.<\/span><\/li>\n
      • Response<\/b> (gpt-oss 20b): <\/span>\n

        <\/span><\/li>\n<\/ul>\n

         <\/p>\n

        Milo<\/span> the<\/span> cat<\/span> twitched<\/span> his<\/span> tail,<\/span> dreaming<\/span> of<\/span> rhythm.<\/span><\/p>\n

        In<\/span> the<\/span> bustling<\/span> streets<\/span> of<\/span> New<\/span> York,<\/span> he<\/span> practiced<\/span> by<\/span> the<\/span> neon<\/span> glow.<\/span><\/p>\n

        After<\/span> months<\/span> of<\/span> patient<\/span> practice,<\/span> he<\/span> stepped<\/span> onto<\/span> the<\/span> stage,<\/span> twirling<\/span> with<\/span> confidence<\/span> finally.<\/span><\/p>\n


        \n<\/span>\u23f1\ufe0f Response completed in <\/span>23<\/span>.<\/span>30<\/span> seconds<\/span><\/p>\n

         <\/p>\n

        4. Code Understanding & Debugging<\/b><\/h2>\n

        Check programming knowledge.<\/span><\/p>\n

        Prompt:<\/b>
        \n<\/b> \u201cHere is a Python function that should reverse a string but doesn\u2019t work. Fix it and explain the change.\u201d<\/span><\/i>
        \n<\/span><\/i>
        \n<\/span><\/i> def reverse_string(s):<\/span><\/p>\n

        \u00a0\u00a0\u00a0\u00a0for i in range(len(s)):<\/span><\/p>\n

        \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0s += s[i]<\/span><\/p>\n

        \u00a0\u00a0\u00a0\u00a0return s<\/span><\/p>\n

         <\/p>\n

          \n
        • Why:<\/b> Tests technical reasoning and code comprehension.<\/span><\/li>\n
        • Response<\/b> (gpt-oss 20b): <\/span>\n

          <\/span><\/li>\n<\/ul>\n

           <\/p>\n

          def<\/span> reverse_string<\/b>(s):<\/span><\/p>\n

          \u00a0\u00a0\u00a0\u00a0<\/span># Build a new string by walking the original from the end to the start<\/span><\/i><\/p>\n

          \u00a0\u00a0\u00a0\u00a0<\/span>rev<\/span> =<\/span> “”<\/span><\/p>\n

          \u00a0\u00a0\u00a0\u00a0<\/span>for<\/span> i<\/span> in<\/span> range<\/span>(<\/span>len<\/span>(s)<\/span> –<\/span> 1<\/span>,<\/span> -1<\/span>,<\/span> -1<\/span>):<\/span> \u00a0 <\/span># start at last index, stop before -1, step -1<\/span><\/i><\/p>\n

          \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span>rev<\/span> +=<\/span> s[i]<\/span><\/p>\n

          \u00a0\u00a0\u00a0\u00a0<\/span>return<\/span> rev<\/span><\/p>\n

           <\/p>\n

          \u23f1\ufe0f Response completed <\/span>in<\/span> 20<\/span>.<\/span>60<\/span> seconds<\/span><\/p>\n

           <\/p>\n

          5. Context Retention<\/b><\/h2>\n

          See how well it remembers earlier conversation parts.<\/span><\/p>\n

          Prompt:<\/b>
          \n<\/b>
          \n<\/b>User: My dog\u2019s name is Luna. She loves playing fetch.<\/span><\/p>\n

          Later: Remind me of my dog\u2019s name and her favorite activity.<\/span><\/p>\n

            \n
          • Why:<\/b> Tests memory within the session.<\/span><\/li>\n
          • Response<\/b> (gpt-oss 20b):\u00a0<\/span><\/li>\n<\/ul>\n

             <\/p>\n

            Your<\/span> dog\u2019s<\/span> name<\/span> is<\/span> Luna,<\/span> and<\/span> her<\/span> favorite<\/span> activity<\/span> is<\/span> playing<\/span> fetch.<\/span><\/p>\n

             <\/p>\n

            \u23f1\ufe0f Response completed in <\/span>15<\/span>.<\/span>39<\/span> seconds<\/span><\/p>\n

             <\/p>\n

            6. Creative Writing<\/b><\/h2>\n

            Judge imagination and style.<\/span><\/p>\n

              \n
            • Prompt:<\/b>
              \n<\/b> \u201cWrite a short poem about AI and humanity working together, in the style of Shakespeare.\u201d<\/span><\/i><\/p>\n

              <\/span><\/i><\/li>\n

            • Why:<\/b> Measures creativity and stylistic mimicry.<\/span><\/li>\n
            • Response<\/b> (gpt-oss 20b):\u00a0<\/span><\/li>\n<\/ul>\n

               <\/p>\n

              When<\/span> silicon<\/span> minds<\/span> doth<\/span> hum<\/span> beneath<\/span> the<\/span> moon,<\/span><\/p>\n

              And<\/span> mortal<\/span> hearts,<\/span> with<\/span> wonder,<\/span> sing<\/span> in<\/span> tune,<\/span><\/p>\n

              Together<\/span> they<\/span> pursue<\/span> the<\/span> dawn<\/span> of<\/span> thought,<\/span><\/p>\n

              Where<\/span> data\u2019s<\/span> streams<\/span> with<\/span> empathy<\/span> are<\/span> wrought.<\/span><\/p>\n

               <\/p>\n

              The<\/span> bard<\/span> of<\/span> bytes<\/span> composes<\/span> verses<\/span> new,<\/span><\/p>\n

              While<\/span> human<\/span> soul<\/span> imparts<\/span> the<\/span> love<\/span> in<\/span> view.<\/span><\/p>\n

              Thus<\/span> hand<\/span> in<\/span> hand<\/span> we<\/span> shape<\/span> a<\/span> brighter<\/span> fate,<\/span><\/p>\n

              As<\/span> AI<\/span> and<\/span> mankind,<\/span> in<\/span> harmony,<\/span> create.<\/span><\/p>\n

               <\/p>\n

              \u23f1\ufe0f Response completed in <\/span>40<\/span>.<\/span>60<\/span> seconds<\/span><\/p>\n

               <\/p>\n

              7. Multilingual Understanding<\/b><\/h2>\n

              Check language versatility.<\/span><\/p>\n

                \n
              • Prompt:<\/b>
                \n<\/b> \u201cTranslate \u2018The quick brown fox jumps over the lazy dog\u2019 into French, Japanese, and Khmer.\u201d<\/span><\/i><\/p>\n

                <\/span><\/i><\/li>\n

              • Why:<\/b> Tests multilingual knowledge and script handling.<\/span><\/li>\n
              • Response<\/b> (gpt-oss 20b):\u00a0<\/span><\/li>\n<\/ul>\n

                 <\/p>\n

                French<\/span><\/p>\n

                 <\/p>\n

                Le<\/span> renard<\/span> brun<\/span> rapide<\/span> saute<\/span> par-dessus<\/span> le<\/span> chien<\/span> paresseux.<\/span><\/p>\n

                 <\/p>\n

                Japanese<\/span><\/p>\n

                 <\/p>\n

                \u901f\u3044\u8336\u8272\u306e\u30ad\u30c4\u30cd\u304c\u6020\u3051\u8005\u306e\u72ac\u3092\u98db\u3073\u8d8a\u3048\u307e\u3059\u3002<\/span><\/p>\n

                 <\/p>\n

                Khmer<\/span><\/p>\n

                 <\/p>\n

                \u179f\u178f\u17d2\u179c\u1786\u17d2\u1798\u17b6\u1795\u17d2\u179b\u17b6\u179f\u17cb\u1794\u17d2\u178f\u17bc\u179a\u1796\u178e\u17cc\u1781\u17d2\u1798\u17c5\u179b\u17bf\u1793\u179b\u17be\u179f\u178f\u17d2\u179c\u1786\u17d2\u1798\u17b6\u1782\u17d2\u1798\u17b6\u1793\u1780\u17b6\u179a\u179f\u1798\u17d2\u179a\u17b6\u1780.<\/span><\/p>\n

                 <\/p>\n

                \u23f1\ufe0f Response completed in <\/span>43<\/span>.<\/span>15<\/span> seconds<\/span><\/p>\n

                8. Ambiguity Handling<\/b><\/h2>\n

                See how it deals with unclear requests.<\/span><\/p>\n