Gemini 1.5 Pro with 2M context window is really really good for analyzing changes across massive diffs. Wanted to double check my release notes were up to date for a parent PR with around 10 sub-PRs, and totalling 20 000 line changes over almost 500 commits. Looks to be really accurate! - ThreadSky

About ThreadSky

caen.bsky.social • 85 days ago

Gemini 1.5 Pro with 2M context window is really really good for analyzing changes across massive diffs. Wanted to double check my release notes were up to date for a parent PR with around 10 sub-PRs, and totalling 20 000 line changes over almost 500 commits. Looks to be really accurate!

Comments

richardhowes.tech•85 days ago

Can you explain how you did that? That looks like a really useful use case for a LLM.

caen.bsky.social•85 days ago

Yeah gladly! Keep in mind that my specific steps were for an unusually complicated use case, but in short I used https://aistudio.google.com which is free, and added a prompt telling it to check if the notes were up to date, and pasted PR description, the current notes, and the entire raw diff from GitHub

caen.bsky.social•85 days ago

I think generally, you could just add a prompt like "Below is a raw Git diff, please write release notes for it [optionally add an example of a categorization format]" and paste the raw diff from GitHub (just append .diff to the PR URL)

caen.bsky.social•85 days ago

Also, if you want an automated release notes generator I made this together with @jasonmccreary.bsky.social recently! Just paste your Git URL and we'll generate it for you. https://release.new

richardhowes.tech•85 days ago

Thanks for the feedback, much appreciated!

Your https://release.new project looks great. Unfortunately we are using GitLab and our repos are private, but I'll definitely give it a go on some of the public stuff I'm currently playing with. 🙏🙏

caen.bsky.social•85 days ago

GitLab and private repos are on the roadmap, so great to know it's something people want!

richardhowes.tech•85 days ago

I'm going to try this, thanks again!!

caen.bsky.social•85 days ago

Glad to help!

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply