The contents of PyPI, in numbers

Total files

1.35 Billion

95,328,294 unique

Total lines of text

429 Billion

428,967,879,093 to be precise

Total uncompressed size

78.0 TiB

That is ~58,437,633.19 floppy disks

Lines of code added per second

5,341

In the month 2024-04-01

This page contains a breakdown of the contents of PyPI from parsing the contents of packages. You can download PyPI locally to do your own analysis or run SQL queries on the data in your browser

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Breakdown

Name	Projects	Percent
list comp	226,072	49
fstring	155,226	34
annotations	131,143	29
generator expression	121,229	26
dict comp	89,232	19
async	29,329	6
dataclasses	26,935	6
set comp	21,746	5
walrus	9,728	2
match	2,676	1
async comp	1,064	0
try star	22	0

Secrets Detected

PyPI contains a lot of secrets.

type	count
Google API Key	5,178
OpenAI API Key	3,982
Tencent Cloud Secret ID	2,529
Amazon AWS Secret Access Key	1,926
Amazon AWS Access Key ID	1,621
Google Cloud Private Key ID	1,235
Slack API Token	1,105
Telegram Bot Token	1,065
Slack Incoming Webhook URL	914
PyPI API Token	846
Google OAuth Access Token	768
SendGrid API Key	758
Tencent WeChat API App ID	739
Mailgun API Key	728
Twilio Account String Identifier	702
Total	31,357

Growth

11.06 million

85TB

1.3 billion

PyPI is growing fast. If this dangerous expansion not stopped, our advanced machine learning models predict that in only 8 years the number of packages will outnumber human beings.

Witness this inevitable future

Binary files

This shows a breakdown of the binary files on PyPI, by extension. Binary files are the vast majority of the content on PyPI, accounting for nearly 75% of the uncompressed size.

extension	total files	total size	unique files
.so	8,778,106	27.6 TiB	4,814,612
.pyd	2,167,926	4.9 TiB	1,977,710
.dylib	1,440,860	4.4 TiB	448,641
.2	182,797	3.5 TiB	22,465
No extension	5,689,743	2.6 TiB	1,978,349
.dll	1,664,072	2.5 TiB	463,405
.0	794,895	1.8 TiB	79,687
.jar	580,471	1.1 TiB	53,248
.1	391,271	668.1 GiB	51,973
.png	27,598,464	609.5 GiB	850,259
.exe	243,582	551.7 GiB	65,234
.lib	145,930	548.3 GiB	41,901
.gz	4,721,524	452.0 GiB	692,964
.tgz	367,369	414.4 GiB	167,969
.a	187,733	408.3 GiB	89,022
Total	54,954,743	52.0 TiB	11,797,439

Largest Projects by size

Tensorflow dominates this list with 12.9 TiB of uncompressed data, 17% of all data on PyPI.

project name	unique files	total files	total lines	total size
tf-nightly	131,257	48,022,472	20,623,931,848	4.7 TiB
tf-nightly-cpu	105,426	28,958,950	12,049,464,903	2.6 TiB
lalsuite	2,028,527	12,473,835	5,765,281,832	1.4 TiB
tf-nightly-gpu	71,119	11,976,657	4,945,537,352	1.4 TiB
fbgemm-gpu-nightly	2,668	44,842	8,935,245	1.1 TiB
tf-nightly-cpu-aws	62,014	13,076,056	5,130,252,053	1.0 TiB
tensorflow	109,945	8,757,327	3,369,233,736	965.7 GiB
paddlepaddle-gpu	33,976	2,072,060	453,389,542	921.7 GiB
graphscope-client	39,577	2,417,047	283,962,015	876.2 GiB
tf-nightly-intel	123,046	11,553,256	4,875,051,602	792.5 GiB
tensorflow-io-nightly	14,020	927,623	116,109,192	742.5 GiB
tensorflow-gpu	83,932	4,284,414	1,578,633,349	639.2 GiB
catboost-dev	32,526	256,620	66,348,683	582.2 GiB
tf-nightly-macos	30,561	6,141,121	2,881,268,907	575.1 GiB
tensorflow-cpu	62,743	5,527,031	2,182,125,715	533.4 GiB
Total	2,931,337	156,489,311	64,329,525,974	18.7 TiB

Stats By Extensions

This only considers the last suffix of the file path as the extension

extension	total files	total lines	total size	unique files
.py	584,486,954	154,693,972,005	5.7 TiB	36,935,177
.h	126,256,918	37,720,208,100	1.4 TiB	803,283
No extension	70,615,331	9,897,343,381	3.1 TiB	18,446,358
.json	66,757,561	29,099,361,863	1.4 TiB	1,829,170
.hpp	49,937,656	10,600,751,310	425.6 GiB	311,678
.txt	44,240,609	20,184,096,986	769.9 GiB	3,686,436
.js	35,376,291	14,723,489,694	1.3 TiB	1,567,727
.png	27,637,863	913,102	609.6 GiB	852,364
.rst	24,586,597	1,528,364,396	58.3 GiB	1,302,090
.pyi	22,755,142	4,340,249,876	143.1 GiB	555,727
.svg	21,843,999	1,520,598,184	195.5 GiB	406,964
.yaml	17,398,756	1,560,837,179	55.9 GiB	409,882
.html	17,092,074	3,399,616,387	250.4 GiB	1,706,219
.md	14,621,588	1,420,414,290	53.3 GiB	1,518,061
.pyc	11,904,900	276,739	79.7 GiB	5,522,568
Total	1,135,512,239	290,690,493,492	15.5 TiB	75,853,704

Files not committed to Github

Not all files can be committed to GitHub due to size limits. Some have a few very, very long lines whilst others are junk like mistakenly added virtualenvs or VCS directories. This table shows a breakdown of the reasons why files where skipped.

skip reason	count	unique files	max size	max lines	total size	total lines	total projects
too-large	8,628,513	954,619	2.2 GiB	151,580,493	9.7 TiB	176,514,737,475	37,384
text-long-lines	1,639,579	180,234	5.0 MiB	5	167.8 GiB	2,624,142	12,408
virtualenv	11,758,334	509,576	3.5 MiB	90,504	113.0 GiB	3,422,388,639	6,081
binary	99,407,171	18,925,583	1.9 GiB	1	59.1 TiB	139,399	119,375
empty	38,740,766	1	0 B	0	0 B	0	243,187
version-control	230,556	32,895	197.0 KiB	10,500	220.7 MiB	5,683,185	721
Total	160,404,919	20,602,908	4.1 GiB	151,681,503	69.0 TiB	179,945,572,840	419,156

The contents of PyPI, in numbers

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Setup.py vs PyProject.toml

Markdown vs RST

Other Files

Typing?

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Mature Features

New Features

Comprehensions