futurama

Advent of Code 2023


Each year dozzens of developers particpate in Advent of Code, a series of riddles and challenges that are intended to be solved by writing code. In 2022 at least 290,510 participants completed a challenge1.

Interestingly if a particpant completed the first star of a challenge, they were extremely likely to complete the second star. Even on the final challenge only 35% of people that got the first star on the challenge didn’t go on complete the full challenge:

ChallengeCompleted Entire ChallengePartially CompletedPct Stalled
2512922709835%
24160812371%
23182252501%
2215118505825%
2122712301712%
20218509924%
19172059355%
1825101487116%
1721194620723%
1622912555720%
1539187571313%
14484619652%
135089312022%
125855110482%
1168131915412%
108418254466%
9815921130612%
810607875267%
711199225552%
615415715801%
515560030562%
418217936572%
3197396111965%
2229512120715%
1276012144985%

I’ll be participating again this year and I’m hoping to make it past my current record of… 7 days. I have good intentions but things always get in the way.

This year I’ll be trying Maciej Caderek’s framework for running the challenges. I’m thinking if there’s a bit more abstraction I’ll have better luck. Last year I tried to make some tooling but ended up spending more time fighting Jest than writing AoC code.

I’m going to stick with TypeScript as much as I’d like to pick up Golang or Rust I don’t have as much time this year.

This year AoC has added a special note asking contestants to not leverage AI to quickly solve problems and get onto the leader board.2

Can I use AI to get on the global leaderboard? Please don’t use AI / LLMs (like GPT) to automatically solve a day’s puzzles until that day’s global leaderboards are full. By “automatically”, I mean using AI to do most or all of the puzzle solving, like handing the puzzle text directly to an LLM. The leaderboards are for human competitors; if you want to compare the speed of your AI solver with others, please do so elsewhere. (If you want to use AI to help you solve puzzles, I can’t really stop you, but I feel like it’s harder to get better at programming if you ask an AI to do the programming for you.)

Footnotes

  1. It’s possible to skip challenges so it’s impossible to tell which participants only completed one of the later challenges so the true number is likely higher. https://adventofcode.com/2022/stats

  2. https://adventofcode.com/about#faq_ai_leaderboard


Thanks for reading! Facts and circumstances may have changed since the publication of this post so it's worth checking for new posts to see if anything's changed before jumping to conclusions.

Have a question or idea? Shoot me an email at _@chip.bz or ping me on mastodon at talking.dev/@chip.