The contents of PyPI, in numbers

Total files

1.06 Billion

79,285,645 unique

Total lines of text

330.8 Billion

330,777,960,596 to be precise

Total uncompressed size

56.8 TiB

That is ~42,548,957.932 floppy disks

Lines of code added per second

3,470

In the month 2023-09-01

This page contains a breakdown of the contents of PyPI from parsing the contents of packages. You can download PyPI locally to do your own analysis or run SQL queries on the data in your browser

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Breakdown

Name	Projects	Percent
list comp	226,072	49
fstring	155,226	34
annotations	131,143	29
generator expression	121,229	26
dict comp	89,232	19
async	29,329	6
dataclasses	26,935	6
set comp	21,746	5
walrus	9,728	2
match	2,676	1
async comp	1,064	0
try star	22	0

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Secrets Detected

PyPI contains a lot of secrets.

type	count
Google API Key	4,086
OpenAI API Key	3,589
Tencent Cloud Secret ID	1,915
Amazon AWS Secret Access Key	1,649
Amazon AWS Access Key ID	1,379
Google Cloud Private Key ID	1,101
Slack API Token	1,065
Telegram Bot Token	872
Slack Incoming Webhook URL	786
SendGrid API Key	749
Mailgun API Key	718
Mailchimp API Key	676
Stripe API Key	662
Twilio Account String Identifier	579
Alibaba Cloud AccessKey Secret	557
Total	25,987

Growth

9.16 million

62TB

1 billion

PyPI is growing fast. If this dangerous expansion not stopped, our advanced machine learning models predict that in only 8 years the number of packages will outnumber human beings.

Witness this inevitable future

Binary files

This shows a breakdown of the binary files on PyPI, by extension. Binary files are the vast majority of the content on PyPI, accounting for nearly 75% of the uncompressed size.

extension	total files	total size	unique files
.so	6,481,438	19.9 TiB	3,598,829
.pyd	1,727,680	4.0 TiB	1,584,250
.dylib	1,067,609	2.8 TiB	350,208
.dll	1,281,199	1.9 TiB	375,221
No extension	4,767,997	1.9 TiB	1,664,068
.2	150,326	1.5 TiB	17,416
.0	591,912	1.2 TiB	65,769
.jar	418,743	846.4 GiB	42,688
.png	24,911,144	495.1 GiB	772,078
.1	287,364	450.7 GiB	39,162
.lib	113,284	432.5 GiB	33,075
.exe	196,364	393.8 GiB	45,364
.gz	4,182,087	382.4 GiB	551,510
.tgz	336,639	360.5 GiB	155,241
.7	37,023	305.1 GiB	2,526
Total	46,550,809	36.7 TiB	9,297,405

Largest Projects by size

Tensorflow dominates this list with 8.9 TiB of uncompressed data, 16% of all data on PyPI.

project name	unique files	total files	total lines	total size
tf-nightly	85,750	20,242,423	8,325,796,068	2.3 TiB
tf-nightly-cpu	80,842	19,960,824	8,080,533,316	1.8 TiB
tf-nightly-gpu	70,457	11,657,756	4,814,002,048	1.4 TiB
lalsuite	1,719,153	9,969,505	4,542,135,454	1.1 TiB
tensorflow	98,196	7,807,727	2,951,575,175	880.0 GiB
paddlepaddle-gpu	30,859	2,000,670	433,161,447	856.7 GiB
tensorflow-io-nightly	14,020	927,623	116,109,192	742.5 GiB
tf-nightly-cpu-aws	50,800	8,689,457	3,360,275,181	708.7 GiB
tensorflow-gpu	83,932	4,276,504	1,575,491,698	638.0 GiB
catboost-dev	32,526	256,620	66,348,683	582.2 GiB
tf-nightly-intel	77,131	7,263,510	2,958,885,573	488.4 GiB
tensorflow-cpu	56,020	5,031,594	1,965,703,970	488.2 GiB
tf-nightly-macos	26,387	5,094,796	2,418,774,151	476.7 GiB
OpenVisus	60,484	3,708,820	730,470,294	437.1 GiB
graphscope-client	36,379	1,326,694	152,810,687	432.4 GiB
Total	2,522,936	108,214,523	42,492,072,937	13.2 TiB

Stats By Extensions

This only considers the last suffix of the file path as the extension

extension	total files	total lines	total size	unique files
.py	459,664,362	120,377,292,204	4.4 TiB	30,918,078
.h	81,745,590	24,636,281,178	973.3 GiB	694,777
No extension	58,499,187	7,731,007,432	2.3 TiB	15,638,539
.json	53,109,304	21,423,529,273	1.1 TiB	1,592,462
.hpp	38,819,102	8,000,600,602	322.8 GiB	280,466
.txt	37,401,985	17,377,558,597	638.7 GiB	3,309,905
.js	31,129,304	12,580,721,105	1.0 TiB	1,312,362
.png	24,946,684	899,348	495.1 GiB	774,733
.rst	21,602,762	1,356,081,964	52.0 GiB	1,232,953
.svg	17,069,842	1,366,621,436	171.8 GiB	317,196
.pyi	16,463,375	3,180,214,428	105.2 GiB	457,005
.html	15,214,453	2,849,552,520	202.8 GiB	1,588,763
.yaml	11,837,963	1,115,674,907	40.1 GiB	329,836
.pyc	10,684,615	276,459	67.4 GiB	4,974,250
.yml	10,001,453	722,017,278	21.4 GiB	300,008
Total	888,189,981	222,718,328,731	11.8 TiB	63,721,333

Files not committed to Github

Not all files can be committed to GitHub due to size limits. Some have a few very, very long lines whilst others are junk like mistakenly added virtualenvs or VCS directories. This table shows a breakdown of the reasons why files where skipped.

skip reason	count	unique files	max size	max lines	total size	total lines	total projects
binary	83,075,298	16,014,492	1.9 GiB	1	42.2 TiB	128,460	108,091
empty	31,092,483	1	0 B	0	0 B	0	211,480
text-long-lines	1,380,322	151,704	5.0 MiB	5	139.7 GiB	2,247,037	9,911
too-large	6,630,189	758,434	1.4 GiB	20,010,001	7.5 TiB	137,335,383,600	31,382
virtualenv	9,513,077	434,124	3.0 MiB	72,778	90.1 GiB	2,723,358,528	5,674
version-control	164,053	27,140	197.0 KiB	10,500	175.6 MiB	4,522,069	609
Total	131,855,422	17,385,895	3.3 GiB	20,093,285	49.9 TiB	140,065,639,694	367,147

The contents of PyPI, in numbers

Language Features

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each containing an async function, it will only be counted once.

Mature Features

New Features

Comprehensions

Breakdown

Project Contents

This data only counts unique projects, not versions. e.g if a project has published 10 versions in a month, each with a setup.py file, it will only be counted once.

Setup.py vs PyProject.toml

Markdown vs RST

Other Files

Typing?