📢 NAACL reviews have been released! 🆕 feature alert: ARR now has review issue flagging! Thanks @jkkummerfeld.bsky.social & OR team for help with implementation, and other EiCs for supporting the idea! It'll be live after author response. More details here: aclrollingreview.org/authors#step... /1 - ThreadSky

annarogers.bsky.social • 97 days ago

📢 NAACL reviews have been released!

🆕 feature alert: ARR now has review issue flagging! Thanks @jkkummerfeld.bsky.social & OR team for help with implementation, and other EiCs for supporting the idea! It'll be live after author response. More details here: https://aclrollingreview.org/authors#step2.2
/1

Comments

mdlhx.bsky.social•97 days ago

Very nice! We systematically refer to the checklist in author responses, this will be much cleaner!

emilevankrieken.com•97 days ago

Why is the rebuttal period 3 days, and in particular over the weekend?

annarogers.bsky.social•97 days ago

Because ARR cycles are only 2 months long. Personally, I disagree that this is how it should be.

Note though that it's not like ICLR rebuttals - it's mostly for clarifications, not for working overtime to bring in new results.

emilevankrieken.com•97 days ago

Thanks for the clarification!

neuralnoise.com•97 days ago

yeah thank god it doesn't span over the weekend, right?

annarogers.bsky.social•97 days ago

Again, I personally disagree with the short cycles because of which this is happening. Would you support a switch to a more quality-focused, less-stressful, slower process? Or is the priority the fast turnaround? If the latter, someone *has* to work on weekends - either authors, reviewers or ACs.

neuralnoise.com•97 days ago

It could easily have been 3 workdays, no?

annarogers.bsky.social•97 days ago

Sure, it just has to come out of non-weekend AC time or reviewer time. And all that process is also constrained by whatever day of week the 15th (submission deadline) happened to be.

There is no free lunch, especially in calendars.

annarogers.bsky.social•97 days ago

There's 12 types of review issues to flag, most are explicitly referenced in reviewer guidelines that authors can cite. Those guidelines have also been fully updated in this cycle: https://aclrollingreview.org/reviewerguidelines
/2

annarogers.bsky.social•97 days ago

The review issue flagging was piloted at ACL'23, you can see the analysis of reported issues in PC report: https://aclanthology.org/2023.acl-long.report.pdf#page=8.55

ARR review issue data will also be analyzed to identify systematic issues & inform the future process. So please do report serious issues when you see them!
/3

annarogers.bsky.social•97 days ago

Author response instructions have also been updated (thanks Mausam and @complingy.bsky.social). New version here: https://aclrollingreview.org/authors#step2.1
/4

Comments

Posting Rules

Reply