How to Scrape Reddit in 2026
A practical guide to Reddit data in 2026, including the May 30 JSON endpoint shutdown, OAuth, PRAW, scraping APIs, and MCP for AI agents.
Short answer: in November 2026, the dependable way to scrape Reddit from code is a third-party Reddit API, because Reddit no longer accepts new API access requests and its unauthenticated .json endpoints return 403. FetchLayer’s Reddit API returns posts, full comment threads, subreddits and user histories as JSON with no Reddit app or approval, at $1.99 per 1,000 requests (30 free to start), and the same data works over MCP at https://mcp.fetchlayer.dev for Claude, ChatGPT and Cursor. For a one-off lookup, the free Reddit scraper needs no account.
Reddit is one of the richest sources of unfiltered opinion on the internet, and in 2026 it is also one of the hardest to get data out of. The free routes have closed one by one, and the official API is now on a published countdown.
This guide covers every way to scrape Reddit that still exists in November 2026: what each one costs, what it can and can’t return, and working code for the method most teams end up using.
The short answer
| You want to… | Use | Why |
|---|---|---|
| Grab a few posts or one thread by hand | The free Reddit scraper | Runs in your browser, exports CSV or JSON, no account. Capped at 25 items per lookup. |
| Pull Reddit data from code, at any volume | A Reddit scraper API | Structured JSON over HTTP, no Reddit app or approval. Step-by-step below. |
| Let Claude, Cursor or another agent read Reddit | An MCP server | The agent calls search and thread tools itself. |
| Keep existing PRAW code running | PRAW pointed at a compatible API | A config change, not a rewrite. |
| Analyse years-old posts in bulk | An archive such as Arctic Shift | See our Pushshift and Arctic Shift guide. |
| Compare paid providers | Our Reddit scraper API comparison | Prices, endpoints and trade-offs side by side. |
What changed, and when
Every date below is from Reddit’s own announcements or the reporting on them; our Reddit API shutdown explainer links the primary sources.
- 2023: Reddit started charging for API access. The only public figure is the 2023 quote to the Apollo app, $12,000 per 50 million requests (details). Most third-party apps shut down.
- 11 November 2025: self-service API access closed. New apps need Reddit’s approval, which most developers report never getting.
- 30 May 2026: unauthenticated
.jsonendpoints began returning 403. - August 2026: old.reddit.com started requiring a login, which closed the last easy fallback for HTML scrapers.
- 30 September 2026: Reddit announced the end of its public Data API. No new access requests have been accepted since 31 October 2026. Reddit shut down its RSS feeds on 18 November 2026, unregistered apps lose access on 12 January 2027, and the remaining public API closes in March 2027 (what it means for PRAW).
After March 2027, the official routes are Reddit’s Devvit platform (for apps that run inside Reddit) or a negotiated commercial agreement. Here are the five methods developers consider today.
Method 1: Legacy JSON endpoints (no longer usable)
Before 30 May 2026, adding .json to most Reddit URLs returned public JSON. Reddit now answers unauthenticated .json requests with 403 Forbidden. The odd success in a logged-in browser doesn’t make it an API; new scripts should assume the request fails.
For reference, this is what the workaround looked like:
// Legacy example: unauthenticated requests now return 403 Forbidden
const res = await fetch('https://www.reddit.com/r/webdev/hot.json?limit=10', {
headers: { 'User-Agent': 'MyApp/1.0' }
});
const data = await res.json();
for (const child of data.data.children) {
console.log(child.data.title, '—', child.data.score, 'points');
}Even when it worked, it had hard limits: listings stopped at 100 items per request, comment threads came back truncated behind "more" stubs, and no commercial use was allowed. Treat it as history.
Need something quick and free instead? The free Reddit scraper runs in your browser with no API key and no signup. Paste a subreddit, user, search or thread link and export CSV or JSON. It returns up to 25 items per lookup without vote scores or comment counts, so it suits manual research rather than production code.
Method 2: PRAW (existing approved apps only, until March 2027)
PRAW is the standard Python wrapper for Reddit’s OAuth API. The library is still maintained, but it doesn’t give you access: you need an approved Reddit app and its credentials, and Reddit stopped accepting new access requests on 31 October 2026.
import praw
reddit = praw.Reddit(
client_id="YOUR_CLIENT_ID",
client_secret="YOUR_CLIENT_SECRET",
user_agent="my-scraper/1.0"
)
for post in reddit.subreddit("startups").hot(limit=10):
print(f"{post.title} — {post.score} points, {post.num_comments} comments")Pros:
- Mature, well-documented library
- Handles OAuth and Reddit’s rate limits for you
- Authenticated actions (posting, voting) for apps that already have access
Cons:
- Needs an approved Reddit app, and new requests are closed
- Python only
- 100 requests per minute, with tighter caps on some endpoints (
/api/morechildrenis about 1 request every 2 seconds) - Non-commercial use only without a written agreement; Reddit doesn’t publish its commercial price (what is known)
- Public API access ends in March 2027 (timeline)
If you already run PRAW code, you don’t have to rewrite it: PRAW can point at a compatible API with a config change. If you don’t have credentials today, treat PRAW as unavailable.
Method 3: DIY scraping (Playwright, Puppeteer, BeautifulSoup)
You can scrape Reddit’s HTML yourself. Reddit’s current site is rendered client-side, so you’ll need a headless browser:
from playwright.sync_api import sync_playwright
with sync_playwright() as p:
browser = p.chromium.launch()
page = browser.new_page()
page.goto("https://www.reddit.com/r/programming/top/?t=week")
page.wait_for_selector("shreddit-post")
for post in page.query_selector_all("shreddit-post")[:10]:
print(post.get_attribute("post-title"), "—", post.get_attribute("score"), "points")
browser.close()Pros:
- Full control over what you extract
- No API key or Reddit app
Cons:
- Fragile: Reddit changes its markup often, and a silent selector failure means empty rows
- Headless browsers are slow and heavy to run at volume
- Reddit blocks automated traffic aggressively, so you’ll be buying and managing proxies (commonly $200–500 a month) and still fighting blocks
- Since August 2026, the lighter old.reddit.com pages need a login
- Comment trees need many extra page loads to expand
DIY only makes sense if you need something no API returns. For posts, comments, subreddits and users, the maintenance costs more than the data.
Method 4: A Reddit scraper API, step by step
A Reddit scraper API returns the same public data as structured JSON over plain HTTP. You don’t need a Reddit app, OAuth or approval, and there’s no scraper to maintain. The examples below use FetchLayer’s API; the same calls are available as a typed npm package, @fetchlayer/reddit (source on GitHub).
Step 1: Get an API key
Create a key in about 30 seconds. The first 30 requests are free and no credit card is needed. Every call is a POST to https://api.fetchlayer.dev/reddit/<endpoint> with a JSON body and your key as a Bearer token.
Step 2: Search Reddit by keyword
const res = await fetch('https://api.fetchlayer.dev/reddit/search', {
method: 'POST',
headers: {
'Authorization': 'Bearer ss-your-fetchlayer-key',
'Content-Type': 'application/json'
},
body: JSON.stringify({
query: 'best CRM for startups',
sort: 'top',
time: 'year',
limit: 25
})
});
const data = await res.json();
for (const post of data.items) {
console.log(`${post.title} — r/${post.subreddit} — ${post.score} pts, ${post.commentCount} comments`);
}Add subreddit: 'saas' to search one community, and include: ['body'] to get the full text of each text post.
Step 3: Pull a subreddit’s posts for a date range (Python)
import requests
API = "https://api.fetchlayer.dev/reddit"
HEADERS = {"Authorization": "Bearer ss-your-fetchlayer-key"}
res = requests.post(f"{API}/community-posts", headers=HEADERS, json={
"subreddit": "python",
"createdAfter": "2026-10-01",
"createdBefore": "2026-11-01",
"limit": 200,
})
data = res.json()
for post in data["items"]:
print(post["createdAt"], post["score"], post["title"])createdAfter and createdBefore take ISO dates and work with the new sort. One limit to know: Reddit only lists roughly the newest 1,000 posts of a community, so on a very busy subreddit the oldest part of a long window may not be reachable through the feed. The response’s notes field tells you when that happens. For older posts, use keyword search with time: 'all', or an archive.
Step 4: Get a full thread with its comment tree
res = requests.post(f"{API}/post", headers=HEADERS, json={
"url": "https://www.reddit.com/r/Python/comments/1xmgv01/",
"depth": 5,
})
thread = res.json()
def walk(comments, indent=0):
for c in comments:
print(" " * indent + f"{c['author']} ({c['score']}): {c['bodyText'][:80]}")
walk(c["children"], indent + 1)
walk(thread["comments"])Comments come back nested, with children at every level. Replies deeper than depth, or that Reddit collapsed, are listed in moreComments, each with an expandToken you can pass to the more-comments endpoint to load them. That’s how you get a complete tree, even on threads with thousands of replies.
Step 5: Paginate, and know what it costs
Pass limit and the API keeps going for you, or page manually by passing a response’s nextCursor back as after. Billing is per page of results actually returned (25 posts per page on feeds), and failed requests aren’t billed. Pulling 10,000 subreddit posts is about 400 pages, which is roughly $0.80 at the pay-as-you-go rate of $1.99 per 1,000 requests, and less on a monthly plan (pricing).
Step 6: Export to CSV
import csv
with open("posts.csv", "w", newline="") as f:
writer = csv.DictWriter(f, fieldnames=["createdAt", "subreddit", "author", "title", "score", "commentCount", "permalink"])
writer.writeheader()
for post in data["items"]:
writer.writerow({k: post.get(k) for k in writer.fieldnames})Every endpoint
| Endpoint | What it returns |
|---|---|
search | Posts matching a keyword, across Reddit or in one subreddit |
search-comments | Comments matching a keyword |
post | Full post body plus the nested comment tree |
more-comments | Replies a thread response didn’t include |
comment-permalink | One comment with its parent context |
community-posts | A subreddit’s feed (hot, new, top, rising, controversial) or a date range |
community-details | Subreddit metadata, subscribers, rules |
search-communities | Subreddits matching a keyword |
user-profile | Karma, bio, account age |
user-posts | A user’s posts |
user-comments | A user’s comment history |
search-users | Users matching a name |
popular | Posts from r/popular |
leaderboard | Top and trending communities |
explore | Communities by topic |
resolve-url-type | What a Reddit URL points to |
Full parameters and response fields are in the Reddit API reference.
Pros:
- Clean JSON, no parsing or selectors
- Any language: it’s plain HTTP
- No Reddit app, credentials or approval
- Pay per page of results, failed requests free
- Also available as an Apify actor and an MCP server
Cons:
- A third-party dependency, like any API
- Live data, not a full archive: for bulk history going back years, pair it with an archive
Method 5: An MCP server for AI agents
If you work in Claude, Cursor, Windsurf or VS Code, you can give the assistant Reddit access through a Model Context Protocol server instead of writing code. Add FetchLayer’s server to your MCP config:
{
"mcpServers": {
"fetchlayer": {
"url": "https://mcp.fetchlayer.dev",
"headers": {
"Authorization": "Bearer ss-your-fetchlayer-key"
}
}
}
}Then ask in plain language:
“Search Reddit for discussions comparing Tailwind and Bootstrap from the past month, read the top 5 threads, and summarise the main arguments.”
The agent calls the search and thread tools, reads the results and answers. MCP calls use the same credits as REST calls. Setup guides: Claude Code, Claude Desktop, Cursor, VS Code.
Which method should you use?
| Method | Best for | Cost | Language |
|---|---|---|---|
| Legacy JSON endpoints | Nothing now (returns 403) | n/a | Any |
| PRAW | Existing approved apps, until March 2027 | Free non-commercial; commercial price unpublished | Python |
| DIY scraping | Data no API returns | Proxies, servers and your time | Any |
| Reddit scraper API | Production code at any volume | 30 free requests, then from $1.99 per 1,000 | Any |
| MCP server | AI agents and IDEs | Same credits as the API | n/a |
For most new projects, a scraper API or the MCP server is the practical choice: the official API is closing, and DIY scraping is a maintenance job. For one-off lookups, the free browser tool is enough.
Frequently asked questions
Is scraping Reddit legal?
Accessing publicly visible data is generally lawful in the US; in hiQ Labs v. LinkedIn, the Ninth Circuit held that scraping public pages doesn’t violate the CFAA. Reddit has also sued scrapers (its October 2025 case against SerpApi, Oxylabs and Perplexity is in discovery), so check your own use case, jurisdiction and how you store personal data. This isn’t legal advice.
Does Reddit still have a free API?
Only for apps that were already approved. Self-service access closed in November 2025, new access requests stopped on 31 October 2026, and the remaining public Data API closes in March 2027. Approved apps get 100 requests per minute for non-commercial use; anything commercial needs a negotiated agreement.
Can I scrape Reddit without an API key?
For a handful of items, yes: the free Reddit scraper needs no key or account. For code, the unauthenticated .json endpoints return 403 since May 2026, so you need either Reddit OAuth credentials (no longer issued) or a third-party API key.
How do I scrape all comments from a Reddit thread?
Request the thread with the post endpoint, then load anything listed in moreComments through more-comments until it’s empty. See Step 4 and our guide to getting every comment on a Reddit post.
Can I get historical Reddit data?
Pushshift’s public API closed in 2023. Today the main free archive is Arctic Shift, which is searchable and was still adding new posts within hours when we checked in November 2026, though it offers no uptime guarantees. Live APIs reach recent and searchable posts, but not a complete multi-year history. Our Pushshift alternative guide compares the options.
How much does it cost to scrape Reddit?
With FetchLayer, the first 30 requests are free, pay-as-you-go is $1.99 per 1,000 requests, and monthly plans lower the rate. A request returns one page of results (25 posts on a feed), so 10,000 posts cost about 400 requests. Failed requests aren’t billed.
How do I avoid getting rate-limited?
On Reddit’s own API, stay under 100 requests per minute and the per-endpoint caps. With a scraper API, Reddit’s limits are the provider’s problem: you send requests and get data back, and FetchLayer doesn’t cap requests per minute on paid credits or plans.
Related guides
- Reddit Scraper API: endpoints, pricing and MCP setup
- Free Reddit scraper: browser tool, CSV and JSON export
- Best Reddit Scraper APIs in 2026: FetchLayer, ScrapeCreators, SociaVault, Apify, ScraperAPI, Bright Data and PRAW compared
- Pushshift and Arctic Shift alternatives: historical Reddit data in 2026
- Reddit API Alternatives in 2026: what replaces the official API
- Migrate PRAW to FetchLayer: keep your PRAW code
- Reddit API npm package: the typed
@fetchlayer/redditSDK
Get a FetchLayer API key: 30 free requests, no credit card.