AI Coding Comparison Challenge. 4 AIs build an HTTP Server in Python. See how they do.

Company provided demo videos are awful, and I'm tired of them lying, glossing over errors and hiding what the AIs got wrong.

So I made my own. The full, unredacted video is at https://www.youtube.com/watch?v=mikK5MoApQM where you can watch everything each AI did right and wrong.

This video is a summarization of what happened, what I learned, what the different AIs did well or did poorly, who "won" and what recommendations I have based on these results.

If you want to learn more about how Internet Software works, sharpen your skills, and have some fun, you can use this link: https://iob.fyi/CodeCrafters to sign up for CodeCrafters free and if you do decide to upgrade later, you'll get 40% off.

00:00 Why this AI demo video is different
02:24 The competitors
03:13 Caveat: Current Point in Time. Current versions of products Sept 2024
03:33 The Challenge
06:27 Problem One: "200 OK"
07:43 Problem Two: "404 Not Found"
09:33 Problem Three: Echo/Request Body
10:30 Summary So Far
11:25 Problem Four: User-Agent/Headers
13:02 Problem Five: Adding a Loop
13:15 Problem Six: Returning a File
14:10 Discussion of Results
15:14 Recommendations
15:19 Observations on Companies
16:19 Thanks to CodeCrafters.io for the playing field
16:34 Closing

My video on Software Testing in an AI world, mentioned in this video: https://youtu.be/02FD59whT5A

My video on Devin's Upwork demo: https://youtu.be/tNmgmwEtoWE

My video on the Claude 3.5 Sonnet coding demo: https://youtu.be/x0y1JWKSUp0