The contents of PyPI, in numbers

Total files

1.05 Billion

78,977,739 unique

Total lines of text

328.3 Billion

328,316,044,764 to be precise

Total uncompressed size

56.4 TiB

That is ~42,223,601.024 floppy disks

Lines of code added per second

3,067

In the month 2023-08-01

This page contains a breakdown of the contents of PyPI from parsing the contents of packages. You can download PyPI locally to do your own analysis or run SQL queries on the data in your browser

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Breakdown

Name	Projects	Percent
list comp	226,072	49
fstring	155,226	34
annotations	131,143	29
generator expression	121,229	26
dict comp	89,232	19
async	29,329	6
dataclasses	26,935	6
set comp	21,746	5
walrus	9,728	2
match	2,676	1
async comp	1,064	0
try star	22	0

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Secrets Detected

PyPI contains a lot of secrets.

type	count
Google API Key	4,072
OpenAI API Key	3,576
Tencent Cloud Secret ID	1,901
Amazon AWS Secret Access Key	1,644
Amazon AWS Access Key ID	1,376
Google Cloud Private Key ID	1,098
Slack API Token	1,063
Telegram Bot Token	868
Slack Incoming Webhook URL	784
SendGrid API Key	749
Mailgun API Key	718
Mailchimp API Key	676
Stripe API Key	662
Twilio Account String Identifier	576
Alibaba Cloud AccessKey Secret	557
Total	25,876

Growth

8.92 million

60TB

1 billion

PyPI is growing fast. If this dangerous expansion not stopped, our advanced machine learning models predict that in only 8 years the number of packages will outnumber human beings.

Witness this inevitable future

Binary files

This shows a breakdown of the binary files on PyPI, by extension. Binary files are the vast majority of the content on PyPI, accounting for nearly 75% of the uncompressed size.

extension	total files	total size	unique files
.so	6,422,856	19.8 TiB	3,576,318
.pyd	1,714,898	4.0 TiB	1,574,613
.dylib	1,060,973	2.7 TiB	349,049
.dll	1,269,571	1.9 TiB	372,842
No extension	4,756,365	1.9 TiB	1,663,203
.2	149,324	1.4 TiB	17,332
.0	587,368	1.2 TiB	65,477
.jar	413,636	839.0 GiB	42,574
.png	24,864,915	492.0 GiB	766,189
.1	285,148	448.4 GiB	39,087
.lib	112,604	430.8 GiB	32,840
.exe	195,016	391.0 GiB	44,737
.gz	4,169,787	380.5 GiB	548,284
.tgz	335,596	358.3 GiB	154,780
.7	36,788	304.7 GiB	2,497
Total	46,374,845	36.4 TiB	9,249,822

Largest Projects by size

Tensorflow dominates this list with 8.9 TiB of uncompressed data, 16% of all data on PyPI.

project name	unique files	total files	total lines	total size
tf-nightly	85,750	20,242,423	8,325,796,068	2.3 TiB
tf-nightly-cpu	80,842	19,960,824	8,080,533,316	1.8 TiB
tf-nightly-gpu	70,457	11,657,756	4,814,002,048	1.4 TiB
lalsuite	1,719,153	9,969,505	4,542,135,454	1.1 TiB
tensorflow	98,007	7,661,737	2,882,658,484	864.7 GiB
paddlepaddle-gpu	30,859	2,000,670	433,161,447	856.7 GiB
tensorflow-io-nightly	14,020	927,623	116,109,192	742.5 GiB
tf-nightly-cpu-aws	50,089	8,442,556	3,263,538,881	689.3 GiB
tensorflow-gpu	83,932	4,276,504	1,575,491,698	638.0 GiB
catboost-dev	32,526	256,620	66,348,683	582.2 GiB
tf-nightly-intel	77,131	7,263,510	2,958,885,573	488.4 GiB
tensorflow-cpu	55,842	4,899,681	1,903,928,312	476.2 GiB
tf-nightly-macos	25,662	4,949,069	2,355,608,468	463.8 GiB
OpenVisus	60,484	3,708,820	730,470,294	437.1 GiB
graphscope-client	36,344	1,308,165	150,594,869	428.1 GiB
Total	2,521,098	107,525,463	42,199,262,787	13.1 TiB

Stats By Extensions

This only considers the last suffix of the file path as the extension

extension	total files	total lines	total size	unique files
.py	456,728,414	119,599,696,853	4.4 TiB	30,841,733
.h	80,999,358	24,415,640,993	965.0 GiB	694,077
No extension	57,819,371	7,675,192,088	2.3 TiB	15,567,174
.json	52,429,291	21,219,289,469	1.0 TiB	1,574,595
.hpp	38,654,579	7,961,407,270	321.2 GiB	278,531
.txt	37,212,425	17,250,193,968	635.8 GiB	3,298,205
.js	30,955,872	12,517,798,279	1.0 TiB	1,300,391
.png	24,900,425	899,161	492.1 GiB	768,803
.rst	21,532,252	1,350,969,858	51.8 GiB	1,230,077
.svg	17,001,283	1,362,585,247	171.3 GiB	314,827
.pyi	16,361,881	3,168,059,211	104.8 GiB	456,382
.html	15,173,561	2,831,448,659	201.4 GiB	1,586,932
.yaml	11,699,374	1,105,027,630	39.7 GiB	327,502
.pyc	10,664,029	276,459	67.3 GiB	4,970,135
.yml	9,970,401	717,493,397	21.3 GiB	298,112
Total	882,102,516	221,175,978,542	11.7 TiB	63,507,476

Files not committed to Github

Not all files can be committed to GitHub due to size limits. Some have a few very, very long lines whilst others are junk like mistakenly added virtualenvs or VCS directories. This table shows a breakdown of the reasons why files where skipped.

skip reason	count	unique files	max size	max lines	total size	total lines	total projects
too-large	6,582,132	752,299	1.4 GiB	20,010,001	7.5 TiB	136,188,932,162	31,237
text-long-lines	1,372,838	150,787	5.0 MiB	5	139.0 GiB	2,236,911	9,890
binary	82,692,161	15,947,755	1.9 GiB	1	41.8 TiB	127,877	107,450
empty	30,888,781	1	0 B	0	0 B	0	209,993
virtualenv	9,462,618	433,532	2.1 MiB	71,126	89.5 GiB	2,706,740,876	5,661
version-control	163,614	27,099	197.0 KiB	10,500	175.2 MiB	4,511,031	608
Total	131,162,144	17,311,473	3.3 GiB	20,091,633	49.5 TiB	138,902,548,857	364,839

The contents of PyPI, in numbers

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Mature Features

New Features

Comprehensions

Breakdown

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Setup.py vs PyProject.toml

Markdown vs RST

Other Files

Typing?