The contents of PyPI, in numbers

Total files

1.34 Billion

94,637,281 unique

Total lines of text

425 Billion

425,014,964,724 to be precise

Total uncompressed size

77.2 TiB

That is ~57,810,875.926 floppy disks

Lines of code added per second

5,341

In the month 2024-04-01

This page contains a breakdown of the contents of PyPI from parsing the contents of packages. You can download PyPI locally to do your own analysis or run SQL queries on the data in your browser

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Breakdown

Name	Projects	Percent
list comp	226,072	49
fstring	155,226	34
annotations	131,143	29
generator expression	121,229	26
dict comp	89,232	19
async	29,329	6
dataclasses	26,935	6
set comp	21,746	5
walrus	9,728	2
match	2,676	1
async comp	1,064	0
try star	22	0

Secrets Detected

PyPI contains a lot of secrets.

type	count
Google API Key	5,140
OpenAI API Key	3,977
Tencent Cloud Secret ID	2,497
Amazon AWS Secret Access Key	1,913
Amazon AWS Access Key ID	1,610
Google Cloud Private Key ID	1,235
Slack API Token	1,104
Telegram Bot Token	1,056
Slack Incoming Webhook URL	909
PyPI API Token	840
Google OAuth Access Token	767
SendGrid API Key	758
Tencent WeChat API App ID	731
Mailgun API Key	728
Twilio Account String Identifier	699
Total	31,183

Growth

11.06 million

85TB

1.3 billion

PyPI is growing fast. If this dangerous expansion not stopped, our advanced machine learning models predict that in only 8 years the number of packages will outnumber human beings.

Witness this inevitable future

Binary files

This shows a breakdown of the binary files on PyPI, by extension. Binary files are the vast majority of the content on PyPI, accounting for nearly 75% of the uncompressed size.

extension	total files	total size	unique files
.so	8,687,891	27.3 TiB	4,778,271
.pyd	2,152,174	4.9 TiB	1,963,691
.dylib	1,426,056	4.3 TiB	444,604
.2	180,944	3.4 TiB	22,305
No extension	5,660,413	2.6 TiB	1,966,694
.dll	1,647,257	2.5 TiB	460,647
.0	785,283	1.7 TiB	78,611
.jar	573,831	1.1 TiB	52,924
.1	384,136	659.9 GiB	49,300
.png	27,516,507	606.3 GiB	849,516
.lib	144,415	545.9 GiB	41,223
.exe	241,942	544.9 GiB	64,378
.gz	4,703,652	449.1 GiB	686,672
.tgz	366,338	413.0 GiB	167,764
.a	186,255	400.0 GiB	87,793
Total	54,657,094	51.4 TiB	11,714,393

Largest Projects by size

Tensorflow dominates this list with 12.7 TiB of uncompressed data, 17% of all data on PyPI.

project name	unique files	total files	total lines	total size
tf-nightly	129,215	46,315,150	19,856,968,773	4.6 TiB
tf-nightly-cpu	104,095	28,637,018	11,904,036,135	2.5 TiB
lalsuite	2,018,326	12,382,853	5,720,346,426	1.4 TiB
tf-nightly-gpu	71,119	11,976,657	4,945,537,352	1.4 TiB
fbgemm-gpu-nightly	2,577	42,442	8,495,125	1.1 TiB
tf-nightly-cpu-aws	62,014	13,076,056	5,130,252,053	1.0 TiB
tensorflow	109,945	8,757,327	3,369,233,736	965.7 GiB
paddlepaddle-gpu	33,976	2,072,060	453,389,542	921.7 GiB
graphscope-client	39,569	2,411,953	283,344,267	874.1 GiB
tf-nightly-intel	121,263	11,421,433	4,815,169,555	783.0 GiB
tensorflow-io-nightly	14,020	927,623	116,109,192	742.5 GiB
tensorflow-gpu	83,932	4,284,414	1,578,633,349	639.2 GiB
catboost-dev	32,526	256,620	66,348,683	582.2 GiB
tf-nightly-macos	30,561	6,141,121	2,881,268,907	575.1 GiB
tensorflow-cpu	62,743	5,527,031	2,182,125,715	533.4 GiB
Total	2,915,881	154,229,758	63,311,258,810	18.5 TiB

Stats By Extensions

This only considers the last suffix of the file path as the extension

extension	total files	total lines	total size	unique files
.py	579,712,261	153,356,416,729	5.6 TiB	36,680,871
.h	124,322,580	37,128,020,653	1.4 TiB	799,790
No extension	70,203,894	9,820,402,960	3.1 TiB	18,336,225
.json	66,369,419	28,880,361,138	1.4 TiB	1,818,976
.hpp	49,316,134	10,453,305,816	419.8 GiB	310,834
.txt	44,001,618	20,108,564,461	763.0 GiB	3,680,483
.js	35,220,207	14,596,284,056	1.3 TiB	1,558,546
.png	27,555,788	912,906	606.4 GiB	851,618
.rst	24,491,527	1,523,098,555	58.1 GiB	1,299,534
.pyi	22,590,930	4,292,004,708	141.6 GiB	546,438
.svg	21,588,061	1,515,287,586	194.5 GiB	405,296
.yaml	17,213,608	1,548,254,755	55.5 GiB	407,578
.html	17,032,773	3,381,212,981	248.8 GiB	1,704,518
.md	14,451,377	1,406,942,338	52.8 GiB	1,514,999
.pyc	11,856,220	276,690	79.3 GiB	5,503,417
Total	1,125,926,397	288,011,346,332	15.3 TiB	75,419,123

Files not committed to Github

Not all files can be committed to GitHub due to size limits. Some have a few very, very long lines whilst others are junk like mistakenly added virtualenvs or VCS directories. This table shows a breakdown of the reasons why files where skipped.

skip reason	count	unique files	max size	max lines	total size	total lines	total projects
virtualenv	11,712,266	508,991	3.5 MiB	90,504	112.5 GiB	3,407,382,721	6,054
text-long-lines	1,632,456	179,581	5.0 MiB	5	167.1 GiB	2,613,636	12,361
too-large	8,543,079	946,937	2.2 GiB	151,580,493	9.6 TiB	174,925,152,545	37,308
binary	98,787,283	18,798,805	1.9 GiB	1	58.4 TiB	139,088	119,000
empty	38,438,291	1	0 B	0	0 B	0	242,542
version-control	228,930	32,807	197.0 KiB	10,500	219.8 MiB	5,663,375	720
Total	159,342,305	20,467,122	4.1 GiB	151,681,503	68.3 TiB	178,340,951,365	417,985

The contents of PyPI, in numbers

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Setup.py vs PyProject.toml

Markdown vs RST

Other Files

Typing?

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Mature Features

New Features

Comprehensions