All posts
ResearchJul 2, 2026 · 13 min

Does Replying to App Reviews Raise Your Rating? The Evidence, by Source

Yes—but the size of the lift depends entirely on whose data you trust. We stratify every credible number by source type, from Google's own telemetry to peer-reviewed studies to vendor reports.

RA

The Argus Team

Reply Argus

Short answer: yes, replying to app reviews raises your rating—but the size of the effect depends entirely on which source you believe, and most articles quote the biggest, softest number without telling you where it came from. Google's own platform data shows the largest lift (+0.7 stars on average). Independent peer-reviewed studies show a real but far smaller effect (a rating changes after roughly 4–5% of replies). Vendor benchmarks sit in between and tend to be the most optimistic. All three point the same direction; they just disagree on magnitude by an order of magnitude.

That gap matters. If you plan a review-response program expecting every reply to lever a review up by nearly a full star, you will be disappointed. If you understand that most replies change nothing, a minority change a single review, and the aggregate still moves your public number—especially under Google's recency-weighted math—you will build a program that actually works. This article does something no competing page does: it separates the evidence by source type, gives each its primary URL and a one-line methodology note, and tells you which claims are load-bearing and which are marketing.

Why does the same question get such wildly different answers?

Because "does replying raise your rating" is really three questions wearing one coat, and each source answers a different one.

The first question is: *when a developer replies, how often does that individual reviewer come back and raise their star?* That is a micro-level, per-reply question, and it is what the rigorous academic studies measure. Their answer is modest: a few percent of replies produce a visible bump on that one review.

The second question is: *across a developer's whole account, does the average rating of apps that reply differ from apps that don't?* That is a correlational, portfolio-level question, and it is what platform telemetry and vendor benchmarks measure. Their answer is large—but correlation is doing heavy lifting, because engaged teams that reply also tend to ship better apps.

The third question is: *does a reply move the public, displayed average rating?* That depends on the platform's rating math, which changed in 2019 in a way that quietly amplified the value of fresh engagement. Most competitor articles never mention it.

Stratifying by source type is the only honest way to answer. Here is the evidence, tier by tier, strongest methodology first.

What does the platform's own data say? (Tier 1: first-party telemetry)

This is the most-cited statistic on the topic, and it comes straight from the company that owns the rating algorithm.

Google, at I/O 2019, reported that when developers respond to reviews, users update their rating by +0.7 stars on average. The exact wording from the announcement: developers respond to more than 100,000 reviews a day in the Play Console, and when they do, Google sees users raise their rating by an average of +0.7 stars. Crucially, this figure is for *all* responses—not just replies to negative reviews. Many blogs mangle it into "responding to a negative review adds 0.7 stars," which overstates the case; the +0.7 is an average across the whole population of replied-to reviews.

Source — Tier 1 (first-party telemetry). Google / Android Developers Blog, "What's new in Google Play" (I/O 2019): android-developers.googleblog.com/2019/05/whats-new-in-play.html — Methodology: aggregate platform telemetry across 100,000+ daily Play Console responses; Google reports the mean rating change but publishes no confidence interval, sample size, or control group. Directionally authoritative because it is measured inside the platform, but not independently reproducible.

Treat +0.7 as the ceiling of the credible range and as a population *average*, not a promise for any single reply. It is the strongest evidence that replying helps, because Google can see the counterfactual (who replied, who didn't, what happened next) at a scale no one else has. It is also the least transparent, because none of the underlying methodology is published. Believe the direction; discount the precision.

What do independent, peer-reviewed studies find? (Tier 2: academic research)

Peer-reviewed software-engineering research is the gold standard here: real data, disclosed methods, published limitations, and—unlike vendors—no product to sell. Three studies dominate the literature, and their honest headline is that the effect is real but small in absolute terms.

McIlroy, Shang, Ali, and Hassan analyzed 10,713 of the top free apps in Google Play and found that after a developer responds, users change their rating 38.7% of the time, with a median increase of 20% (roughly one star on a five-star scale). That 38.7% is the most-quoted academic number, and it is often misread. It does *not* mean 38.7% of all reviews improve when you reply. It means that *among the specific reviews where a rating change occurred after a response*, the change was an increase 38.7% of the time—a conditional figure. The same study found only 13.8% of apps replied to even a single review, and none of the most-reviewed apps replied at all. Responding was rare, and where it worked, it worked meaningfully but selectively.

Source — Tier 2 (peer-reviewed). McIlroy et al., "Is It Worth Responding to Reviews? Studying the Top Free Apps in Google Play," IEEE Software 34(3), 2017: ieeexplore.ieee.org/document/7325189/ — Methodology: observational analysis of 10,713 top free Google Play apps; measures rating changes following developer responses. Observational, not randomized: developers choose which reviews to answer, so selection bias likely inflates apparent effect.

Hassan et al. ran the largest study of this mechanism—4.5 million reviews and 126,686 developer responses—and found that responding makes a user roughly six times more likely to raise their rating (4.4% of responded-to reviews saw an increase versus 0.7% of reviews with no response). This is the number to internalize, because it captures both truths at once. The *relative* effect is dramatic: 6x. The *absolute* effect is small: even with a reply, only about one review in twenty-three gets bumped up. A 6x multiplier on a low base rate is still a low rate. This is why replying is worth doing at scale (small percentages compound across thousands of reviews) but is not a magic wand for any individual review.

Source — Tier 2 (peer-reviewed). Hassan et al., "Studying the Dialogue Between Users and Developers of Free Apps in the Google Play Store," Empirical Software Engineering, 2018 (Springer / SAIL Lab): sailresearch.github.io/sail-website/data/pdfs/EMSE2017_StudyingTheDialogueBetweenUsersAndDevelopers.pdf — Methodology: mixed-effects modeling over 4.5M reviews and 126,686 responses; reports both relative odds (≈6x) and absolute rates (4.4% vs 0.7%). Largest sample in the literature; still observational.

The most actionable academic work asks a sharper question: not *whether* to reply, but *how* to reply so the odds tip in your favor. Srisopha et al. (EASE 2021) studied 1,600 apps over 10 weeks and found that about 4.8% of 1–4★ reviews rose after a developer reply—and, more usefully, ranked the features that predict a successful response. In order of predictive strength:

  1. Reply-length ratio — responses proportioned to the review (substantial, not one-line brush-offs) predict success most strongly.
  2. Textual similarity to the review — replies that echo the reviewer's own words and address their specific point, rather than boilerplate, do better.
  3. Timeliness — faster responses, while the complaint is still fresh in the user's mind, convert more often.
  4. Politeness — courteous tone helps, but ranks *below* substance, specificity, and speed.

Source — Tier 2 (peer-reviewed). Srisopha, Link, Boehm, "How Should Developers Respond to App Reviews? Features Predicting the Success of Developer Responses," EASE 2021 (ACM): dl.acm.org/doi/fullHtml/10.1145/3463274.3463311 — Methodology: 1,600 apps tracked 10 weeks; defines "success" as a rating increase after a reply (~4.8% of 1–4★ reviews) and ranks predictive features. Observational, but the feature ranking is the field's best guidance on reply craft.

The academic tier is the one to weight most heavily, because it is the only tier that discloses its methods and publishes its own caveats. Its verdict: replying moves ratings for a *few percent* of reviews, is ~6x better than staying silent, and works best when the reply is substantial, specific, fast, and polite—in that order.

What do the vendor benchmarks claim? (Tier 3: commercial reports)

Vendor reports are where the biggest, most quotable numbers live—and where you should apply the most skepticism, because the companies publishing them sell review-management or rating-optimization products. That does not make the numbers wrong; it makes them un-auditable. Read them as directional signals, not as measured facts.

Apptentive's Ratings & Reviews research reports that moving an app from 3 stars to 4 stars can lift conversion (installs from a store listing) by 89%. This is not a claim about replying per se—it is a claim about what a higher rating is *worth* once you get there, which is the whole reason replying matters. It is also the single most-recycled stat in the app-marketing world, usually stripped of its source. Note carefully: the underlying methodology is not public, so the exact 89% should be treated as an order-of-magnitude signal ("crossing the 4-star line roughly doubles conversion") rather than a precise coefficient.

Source — Tier 3 (vendor). Apptentive Mobile App Ratings & Reviews report (as cited across app-marketing coverage, e.g. AppsFlyer): www.appsflyer.com/blog/tips-strategy/app-ratings-reviews/ — Methodology: vendor survey/analytics; the 89% (3★→4★ conversion lift) is widely cited but the sample, time window, and computation are not publicly disclosed. Use as a directional signal only.

The most valuable vendor data on this topic is a per-star *conversion curve*—how install likelihood scales with displayed rating. NP Digital analyzed 49 companies in April 2024 and produced a per-star conversion index, normalized so a 5-star listing equals 1.00. No competing article on this topic puts this sourced curve on the page, so here it is in full.

  • 5.0★ — 1.00 (baseline; maximum conversion)
  • 4.5★ — 0.96 (a half-star drop costs only ~4%; the top of the range is forgiving)
  • 4.0★ — 0.83 (still healthy—4.0 is the psychological floor of "good")
  • 3.0★ — 0.57 (conversion nearly halves; this is the cliff edge)
  • 2.0★ — 0.15 (collapse; the listing converts at a fraction of its potential)
  • 1.0★ — 0.08 (effectively unmarketable)

Source — Tier 3 (vendor). NP Digital / Neil Patel, app-downloads-vs-ratings analysis, April 2024, 49 companies: neilpatel.com/marketing-stats/app-downloads-vs-ratings/ — Methodology: cross-company analysis of download rates indexed to star rating; sample of 49 firms, index normalized to 5★ = 1.00. Correlational and commercial, but the shape of the curve is consistent with academic and platform findings.

The curve explains *why* the math of replying matters so much between 3.0 and 4.0 stars. The drop from 5.0 to 4.5 costs almost nothing (0.96), but the drop from 4.0 to 3.0 nearly halves your conversion (0.83 → 0.57). Every fraction of a star you protect in that band is worth far more than a fraction of a star at the top. Replying to reviews is one of the few levers that nudges the displayed number in exactly that band, because the reviews you can most productively answer are the 1–3★ ones dragging you toward the cliff.

How much do developers actually reply, and does reply rate correlate with rating? (Tier 3: benchmarks)

If replying helps, you would expect apps that reply more to rate higher. The benchmark data says exactly that—with the standard correlation caveat.

First, ignore the ancient numbers. The widely-repeated "only 3.3% of developers reply" figure dates to around 2015 and is badly out of date. By 2022, Appbot found roughly 11% of reviews were getting a developer response—an almost 400% increase from 2.9% in 2016. Reply behavior is also correctly skewed toward the reviews that matter: Appbot's data shows developers reply to about 18% of 1–2★ reviews versus roughly 9% of 4–5★ reviews. Teams already know instinctively that low stars are where a reply earns its keep.

Source — Tier 3 (benchmark). Appbot, "Responding to app store reviews: the staggering growth" (2022): appbot.co/blog/responding-to-app-store-reviews-the-staggering-growth/ — Methodology: aggregate analysis across Appbot's monitored app base; reports overall reply rate (~11%) and by-star skew (18% of 1–2★ vs 9% of 4–5★). Vendor data; large but non-random sample.

Second, the correlation between reply rate and rating is real and sizable. AppFollow found that apps replying to 30–50% of their reviews average a 3.77★ store rating, versus 3.25★ for apps replying to under 1%. That is a half-star gap correlated purely with engagement level. Half a star, per the NP Digital curve above, is the difference between a healthy listing and one sliding toward the 3.0 cliff.

Source — Tier 3 (benchmark). AppFollow, "How replies affect the average rating": get.appfollow.io/how-replies-affect-the-average-rating — Methodology: cross-app comparison of reply rate versus average store rating; apps at 30–50% reply rate average 3.77★ vs 3.25★ under 1%. Correlational: high-reply teams likely also build better apps, so the gap is not purely causal.

The AppFollow and Appbot gaps are correlations, not experiments. Teams disciplined enough to reply to a third of their reviews are usually also disciplined about crash fixes, onboarding, and release quality—all of which independently lift ratings. The half-star gap is the combined signature of an engaged team, not the isolated effect of typing replies. Replying is part of the causal story; it is not the whole story.

Why do fresh replies move the number faster now? (The recency-weighting mechanism)

Here is the piece almost every competitor article omits, and it is the mechanism that ties all the tiers together.

At I/O 2019, Google changed how Play calculates an app's displayed average rating: it moved from a lifetime-cumulative average to a recency-weighted average that emphasizes recent releases and recent reviews. Before the change, every rating you ever received counted equally forever, so a mountain of old ratings made your average almost immovable—a single new 5★ was a drop in a very large bucket. After the change, recent ratings carry more weight, so the displayed number responds much faster to what is happening *now*.

Why this matters for replies. Under recency-weighting, a reply that persuades a user to update a *fresh* 2★ to a 4★ moves your visible average far more than the same edit would have under the old lifetime-cumulative math—because recent reviews are exactly the ones the algorithm now weights most heavily. Timely replies (a top Srisopha success predictor) and recency-weighting compound: the sooner you convert a fresh low star, the more of the algorithm's weight you capture. This is the single strongest argument for replying quickly rather than in a monthly batch.

Recency-weighting also reframes the modest academic percentages. If only ~4–5% of replies flip a review, but the reviews you are flipping are *recent* ones carrying outsized weight, then a small per-reply success rate translates into a disproportionately large move in the displayed average. The academic magnitude (small) and the platform magnitude (+0.7) stop looking contradictory once you understand that the platform is measuring the number after the algorithm's recency lens has amplified the fresh conversions.

So what should you actually do? (The evidence-based playbook)

Every tier of evidence converges on the same operating instructions. The academic feature-ranking tells you *how* to write a reply; the recency mechanism tells you *when*; the conversion curve tells you *which* reviews are worth the most. Put together, the playbook is unambiguous.

  1. 1

    Reply to fresh 1–3★ reviews within 24–48 hours.

    Timeliness is a top-ranked success predictor (Srisopha), and recency-weighting means the fresher the review, the more its update moves your public average. Speed is the highest-leverage variable you control.

  2. 2

    Cover every 1–3★ review, not just the loudest.

    The academic effect is a few percent per reply, so the returns come from volume across the whole low-star band—the exact band where the NP Digital curve punishes you hardest (3.0★ = 0.57 conversion). Systematic coverage beats heroic one-offs.

  3. 3

    Be specific: echo the reviewer's own words and address their exact problem.

    Textual similarity to the review is a stronger success predictor than politeness. Boilerplate underperforms; a reply that names the bug, screen, or feature the user mentioned does measurably better.

  4. 4

    Match the reply length to the review.

    Reply-length ratio is the single strongest predictor of success. A one-line "Sorry to hear that!" on a detailed complaint is the worst-performing pattern in the data. Proportion your effort to theirs.

  5. 5

    Stay polite—but don't stop at polite.

    Courtesy helps and costs nothing, yet it ranks below substance, specificity, and speed. Politeness is the floor, not the strategy.

  6. 6

    Reply in the user's own language.

    A reviewer writing in Portuguese or Japanese who receives an English template will rarely return to update their star. Textual similarity and genuine comprehension both break down across a language mismatch, so answer in the language the review was written in.

  7. 7

    Tell users when you've fixed their issue, and ask them to reconsider.

    The 4.4%-vs-0.7% and 38.7% figures exist because some users *do* come back and raise their star when a developer closes the loop. A reply that says "this is fixed in version X" gives them a concrete reason to update.

None of this requires a tool—a disciplined founder with a spreadsheet and a fast turnaround can execute the entire playbook by hand. What a tool changes is coverage and speed at volume: catching every fresh 1–3★ across stores, in every language, within the 24–48 hour window, without the process quietly lapsing during a busy release week. That is the narrow, honest role software like [Reply Argus](replyargus.com) plays—operationalizing the evidence above, not replacing the judgment behind it.

The bottom line across every source: replying to app reviews raises your rating. Google's telemetry puts the average lift at +0.7 stars; peer-reviewed research puts the per-reply effect at a few percent but ~6x better than silence; vendor benchmarks show a half-star gap between high-reply and low-reply apps and an 89% conversion swing at the 3★→4★ line. The numbers disagree on magnitude precisely because they measure different things—individual reviews, whole accounts, and displayed averages. They agree completely on direction. Reply fast, reply specifically, reply to every low star, and let Google's recency-weighted math do the compounding.

Frequently asked

Does replying to a review directly change that review's star rating?
Only if the reviewer chooses to come back and edit it—a developer cannot change a user's star. The peer-reviewed data shows this happens for roughly 4–5% of replied-to reviews (Hassan et al.: 4.4% vs 0.7% for un-replied reviews; Srisopha et al.: ~4.8% of 1–4★). It is about 6x more likely to happen when you reply than when you don't, but it remains the exception per reply. The aggregate lift comes from doing it at volume.
Is the +0.7 stars figure trustworthy?
It is trustworthy in direction and comes from the most authoritative possible source—Google's own platform telemetry, reported at I/O 2019 across 100,000+ daily Play Console responses. But it is an average across *all* replies (not just negative ones), and Google published no sample size, confidence interval, or control group. Treat +0.7 as the optimistic ceiling of the credible range, not a guaranteed per-reply outcome.
Should I reply to positive reviews too, or only negative ones?
Prioritize fresh 1–3★ reviews—that is where a reply can flip a star and where the conversion curve punishes you most (3.0★ converts at 0.57 vs 5.0★ at 1.00, per NP Digital). Google's +0.7 average, though, is measured across all responses, and thanking happy users reinforces good ratings and signals an engaged team. If you have limited time, spend it on low stars first; if you have capacity, cover positives too.
How fast do I need to reply for it to matter?
Aim for 24–48 hours on fresh low-star reviews. Timeliness is a top success predictor in Srisopha et al., and since Google's 2019 switch to recency-weighted averages, recent reviews carry more weight in your displayed rating—so converting a fresh low star moves the public number faster than converting an old one. Speed compounds with the algorithm.
Why did my average rating barely move even though I replied to lots of reviews?
Two reasons. First, the per-reply effect is genuinely small—most replies don't change the star, they just improve the odds. Second, if your app has a very large history of ratings, even recency-weighting takes time and volume to shift the visible average. Replies work by compounding across many fresh low-star reviews over weeks, not by moving the needle after a handful of responses.
Do I have to reply in the reviewer's language?
Yes, if you want the reply to actually convert. A user who wrote in their native language and receives an English template rarely returns to update their star—the specificity and comprehension that drive success (textual similarity is a top Srisopha predictor) both collapse across a language mismatch. Answer each review in the language it was written in.

Try it

Let Argus draft your next reply.

Watch it answer a real review in your voice. 10-day trial, no card to begin.

See the features or pricing.

Keep reading