Double-Blind Peer Review: How It Works

Double-blind peer review is a standard evaluation process used by many academic conferences and journals, particularly in computer science. Understanding how it works is essential before submitting your paper.

What is Double-Blind Review?

Double-blind review means that reviewers and authors remain anonymous to each other throughout the evaluation process. Neither party knows the identity of the other. This contrasts with single-blind review, where reviewers know the authors’ identities but authors don’t know who reviewed their work.

The anonymity in double-blind review is designed to reduce bias based on:

• Author reputation or institutional affiliation
• Personal or professional relationships
• Past publication history
• Geographic or demographic factors

Single-Blind vs. Double-Blind Review

Single-blind review is more common in some fields. Reviewers see author names and affiliations, while authors remain unaware of their reviewers’ identities. This is easier to administer but introduces potential bias.

Double-blind review requires additional care during the submission and review process. Both parties are protected from knowing each other’s identities, though conference organizers typically maintain records for administrative purposes.

Best Practices for Double-Blind Submissions

When preparing your paper for double-blind review:

• Remove identifying information: Don’t include author names, affiliations, or acknowledgments that reveal your identity in the main document
• Anonymize references carefully: Refer to your own prior work in third person (e.g., “Smith et al. [15] showed…” rather than “In our previous work…”)
• Check metadata: Remove author metadata from PDF files before submission
• Avoid distinctive writing patterns: Double-blind review isn’t foolproof; reviewers may infer identity from style or cited work
• Use anonymous accounts if the conference platform requires them

Why Conferences Use Double-Blind Review

Major computer science conferences increasingly adopt double-blind review because it promotes fairness. A paper’s merits should be evaluated on content and methodology, not on the author’s prior publications or institutional prestige.

However, double-blind review requires strong conference organization to maintain integrity. Conference chairs and organizers must ensure:

• Reviewers don’t attempt to identify authors
• Author information in submissions is properly redacted
• The review platform doesn’t leak identifying data

Limitations

Double-blind review isn’t perfect. In specialized research areas, reviewers may identify authors through distinctive work or citations. In some cases, authors may inadvertently include identifying information. Nonetheless, it significantly reduces bias compared to open review.

Checking Conference Requirements

Before submitting to any conference (including NAS, NIPS, ICML, or others), verify the exact double-blind requirements:

• Review the conference’s submission guidelines carefully
• Check whether the platform enforces anonymization automatically
• Look for specific rules about author references and citations
• Note any deadlines for withdrawing non-anonymous submissions

Double-blind review represents a best practice for maintaining scientific integrity, even though it adds administrative overhead. When submitting to conferences that use this system, take the time to properly anonymize your work.