数据集 ▶ 上传到安娜的档案 [upload]
如果您有兴趣镜像此数据集以用于存档或大语言模型训练目的，请联系我们。
从Datasets页面概览。
来源 元数据 文件
上传到安娜的档案 [upload]
对各种较小或一次性的来源。我们鼓励人们先上传到其他影子图书馆，但有时人们的收藏太大，其他人无法整理，但又不足以单独分类。

各种较小或一次性的来源。我们鼓励人们先上传到其他影子图书馆，但有时人们的收藏太大，其他人无法整理，但又不足以单独分类。

“上传”收藏被分成较小的子收藏，这些子收藏在 AACIDs 和种子名称中有所标示。所有子收藏首先与主收藏进行去重，尽管元数据“upload_records”JSON 文件仍包含许多对原始文件的引用。大多数子收藏中也删除了非书籍文件，通常在“upload_records”JSON 中未注明 not。

许多子收藏本身由子子收藏组成（例如来自不同的原始来源），这些子子收藏在“filepath”字段中表示为目录。

子收藏包括：

子合集 备注
aaaaarg 浏览 搜索 来自 aaaaarg.fail。看起来相当完整。来自我们的志愿者“cgiym”。
acm 浏览 搜索 来自 ACM Digital Library 2020 的种子。与现有的论文集合有相当高的重叠，但很少有MD5匹配，因此我们决定完全保留它。
airitibooks 浏览 搜索 对iRead eBooks（发音为ai rit i-books；airitibooks.com）的抓取，由志愿者j完成。对应于其他metadata抓取中的airitibooksmetadata。
alexandrina 浏览 搜索 来自亚历山大图书馆的收藏。部分来自原始来源，部分来自the-eye.eu，部分来自其他镜像。
bibliotik 浏览 搜索 来自一个私人图书种子网站 Bibliotik（通常称为“Bib”），这些书籍按名称（A.torrent, B.torrent）打包成种子并通过the-eye.eu分发。
bpb9v_cadal 浏览 搜索 来自我们的志愿者“bpb9v”。有关 CADAL 的更多信息，请参阅我们 读秀数据集页面 中的注释。
bpb9v_direct 浏览 搜索 More from our volunteer bpb9v, mostly DuXiu files, as well as a folder WenQu and SuperStar_Journals (SuperStar is the company behind DuXiu). “WenQu Classics Library(文曲经典图书馆): This site is inaccessible now, because someone (probably book sellers) scraped too much data in a short time. There are about 80k PDF files, and 4k epub (and a few mobi) files. All pdf files are on the official site therefore inaccessible now. But epub files are stored on Aliyun server. They're all uploaded.” “SuperStar Journals(超星期刊): These journals can be read in links like https://epubf.5read.com/qikan/ZYJC/ZYJC202201/index.html and the original PDF file can be downloaded in https://epubf.5read.com/qikan/ZYJC/ZYJC202201/files/extfile/ebook.pdf. ZYJC is the abbreviation of 中国中医基础医学杂志(in Pinyin). 220101 means issue 1 in 2022.”
cgiym_chinese 浏览 搜索 From our volunteer cgiym, Chinese texts from various sources (represented as subdirectories), including from China Machine Press (CMPEDU) (a major Chinese publisher).
cgiym_more 浏览 搜索 来自我们的志愿者“cgiym”的非中文集合（表示为子目录）。
chinese_architecture 浏览 搜索 关于中国建筑的书籍抓取，由志愿者cm完成：我通过利用出版社的网络漏洞获取了这些书籍，但该漏洞现已被修复。对应于其他metadata抓取中的chinese_architecturemetadata。
clara_nz_2025_10 浏览 搜索 Scrape of clara.nz. There are two folders of particular interest. standards/documents/ includes almost the entirety of ISO, IEEE, and SAE standards. hardware/ contains a large amount of hardware documentation.
cmpedu 浏览 搜索 Scrape of China Machine Press (CMPEDU), a major Chinese publisher. By volunteer cgiym.
chinese_2025_10/dedao 浏览 搜索 Scrape of China Platform Book Library, by volunteer qp.
chinese_2025_10/duxiu_ts 浏览 搜索 More DuXiu files in the TS* format (newer files), scraped by volunteer “w”.
chinese_2025_10/gxds_epub 浏览 搜索 Split from duxiu_main2/国学大师资源库 (see below). Volunteer “woz9ts” explains: “国学大师资源库 is https://www.guoxuedashi.net/. This website has a good collection of ancient books. It released many versions of local book readers (with encrypted metadata and fulltext databases). I have found a way to extract the key and decrypt the databases. My "gxds" collection covers the 国学大师资源库/软件 folder.” Additional original data and code can be found in our chinese_2025_10_original_metadata.tar.zst archive.
chinese_2025_10/huafuzhi 浏览 搜索 Scrape of huafuzhi.com, by volunteer “w”. Mainly published by c-textilep (China Textile Publishing). Additional metadata can be found in our chinese_2025_10_original_metadata.tar.zst archive.
chinese_2025_10/huawen_library 浏览 搜索 Scrape of 台湾华文电子书库 (Taiwan e-Book), by volunteer “bl”. Volunteer “bpb9v” notes: “I think the private community in Guoxuedashi scraped this before. I saw a collection on a book seller's site.” Corresponds to huawen_library metadata in Other metadata scrapes.
chinese_2025_10/ptpress 浏览 搜索 Scrape of Posts & Telecom Press by volunteer “w”. Corresponds to ptpress metadata in Other metadata scrapes.
chinese_2025_10/sciencereading1
chinese_2025_10/sciencereading2
chinese_2025_10/sciencereading3		 浏览 搜索1 搜索2 搜索3 Scrape of ScienceReading, by volunteers “qp”, “w”, and “ma”. “qp” explains: “In August 2024, there was an unprecedented vulnerability on the website. We arranged about 30 people to crawl it. Corresponds to sciencereading metadata in Other metadata scrapes.
chinese_2025_10/shanghai_library_ancient 浏览 搜索 Ancient books from Shanghai Library.
chinese_2025_10/zjjd 浏览 搜索 Scrape of ZJJD.cn, by volunteer “w”. More info: [1]. Many books are only a preview version and have therefore only metadata. “w” decrypted ".zjjd" extension to ".pdf", using AES password "xSeZw1dY2HKAj3yk". Corresponds to zjjd metadata in Other metadata scrapes.
degruyter 浏览 搜索 从几个大型种子中收集的学术出版社 De Gruyter 的书籍。
docer 浏览 搜索 抓取自 docer.pl，一个专注于书籍和其他书面作品的波兰文件共享网站。由志愿者“p”在2023年末抓取。我们没有从原网站获得好的元数据（甚至没有文件扩展名），但我们过滤了类似书籍的文件，并且通常能够从文件本身提取元数据。
duxiu_epub 浏览 搜索 由志愿者“w”收集的读秀的epub文件。读秀仅提供最近几年书籍的电子版，因此这个集合中的大部分书都是很新的。
duxiu_main 浏览 搜索 来自志愿者“m”的剩余读秀文件，这些文件不是读秀专有的PDG格式（主要的 读秀数据集）。从许多原始来源收集，可惜没有在文件路径中保留这些来源。
duxiu_main2 浏览 搜索 Contains different subfolders. Of note:
 
万方新方志45616: Volunteer “woz9ts” explains: “万方新方志45616 is a important collection. 方志 is a type of book, that contains history, economy, agriculture, geography, culture, and other commentaries about a town/county. These are compiled every few decades by the local government. XFZ means 新 (new) 方志. 万方 is a digital library.” Data seems to be stitched together from smaller PDFs (see './江苏省/XFZ20651.《 南京市志》第一册(总述、大事专记、地理、人口、环保)/combin.bat'), and pdf content creator seems to be 'pdftk'. All seem to be generated around Aug 11, 2020. Filenames in duxiu_main2/万方新方志45616 are matched to Wanfang’s titles. Corresponds to wanfang metadata in Other metadata scrapes.
 
国学大师资源库/guji: related links [1] [2] [3] [4] [5].
elsevier 浏览 搜索
emo37c 浏览 搜索
french 浏览 搜索
french2_2025_10 浏览 搜索 Collection of French books, by volunteer je.
gallica_2025_10 浏览 搜索 Books from Gallica, managed by the Bibliothèque National de France (BNF), by volunteer pa. Representing about 7% of the Gallica book collection at the time of scrape.
hathi 浏览 搜索 Scrape of files from HathiTrust, better quality than our main HathiTrust collection, but way fewer books. Some filenames are missing the full ID at the end, but hathi_upload_index.txt in the repo fixes this. By volunteer no.
hentai 浏览 搜索 对情色书籍的抓取，由志愿者do no harm完成。对应于其他metadata抓取中的hentaimetadata。
ia_multipart 浏览 搜索
imslp 浏览 搜索
japanese_manga 浏览 搜索 由志愿者“t”从一家日本漫画出版社抓取的集合。
longquan_archives 浏览 搜索 由志愿者“c”提供的龙泉司法档案精选。
magzdb 浏览 搜索 抓取自 magzdb.org，Library Genesis的盟友（它链接在libgen.rs主页上），但他们不想直接提供他们的文件。由志愿者“p”在2023年末获得。
mangaz_com 浏览 搜索
misc
misc_2025_10		 浏览 搜索1
搜索2
Various small uploads, too small as their own subcollection, but represented as directories.
- The oo42hcksBxZYAOjqwGWu directory corresponds to the czech_oo42hcks metadata in Other metadata scrapes.
motw_a1d_2025_10
motw_shc_2025_10		 浏览1 搜索1
搜索		 Scrape of “Memory of the World” (not to be confused with the UNESCO program) by volunter ”an”. a1d is incomplete; shc is complete. Corresponds to motw metadata in Other metadata scrapes.
newsarch_ebooks
newsarch_ebooks_2025_10		 浏览 搜索1
搜索2		 来自AvaxHome的电子书，这是一个俄罗斯的文件共享网站。
newsarch_magz 浏览 搜索 报纸和杂志的存档。对应于其他metadata抓取中的newsarch_magzmetadata。
pdcnet_org 浏览 搜索 对哲学文献中心的抓取。
polish 浏览 搜索 志愿者“o”的集合，他直接从原始发布（“scene”）网站收集波兰书籍。
shuge 浏览 搜索 由志愿者“cgiym”和“woz9ts”收集的 shuge.org 的合并集合。
shukui_net_cdl 浏览 搜索 Scrape of Shukui.net, a Chinese shadow library with a peculiar way of distributing and encrypting files. We speculate that the decryption site jyjl.org is run by the same person but kept separate to avoid legal issues. We managed to get their “secondary library” (CDL, Chinese Digital Library, 中国数字图书馆, built by National Library of China). The “primary library” still remains to be done, though it seems to have signficant overlap with our existing “DuXiu” collection.
 
Volunteer “bpb9v” explains: “They never mentioned the full name of this library but "中数". I guess it refers to "中国数字图书馆(Chinese DIgital Library, CDL)". This library is built by a company that belongs to the national library. Sometimes it's called "中数书屋(CDL Book Room)".”
 
Additional code can be found in our chinese_2025_10_original_metadata.tar.zst archive. Corresponds to shukui metadata in Other metadata scrapes.
trantor 浏览 搜索 “川陀帝国图书馆”（以虚构的图书馆命名），由志愿者“t”在2022年抓取。
turkish_pdfs 浏览 搜索
twlibrary 浏览 搜索 Scrape of a shadow library “台湾图书馆馆藏书籍（2T）”, by volunteer “woz9ts”. It looks like it comes from these official sites [1] [2]. We combined metadata from 台湾特藏预览.zip and 【新】台湾特藏目录.xlsx. We converted files to PDFs but also kept the original .zip files (since some didn’t convert properly). Corresponds to twlibrary metadata in Other metadata scrapes.
wll 浏览 搜索 Yet another complete library of the world. The original library also contains videos and music, and has been preserved in its entirety in a torrent, as a historical curiosity.
woz9ts_direct 浏览 搜索 Sub-sub-collections (represented as directories) from volunteer woz9ts: program-think, haodoo (additional metadata and code: [1] [2] [3]), skqs (by Dizhi(迪志) in Taiwan; in two places: [1] [2]), mebook (mebook.cc, 我的小书屋, my little bookroom — woz9ts: This site mainly focused on sharing high quality ebook files, some of which are typeset by the owner himself. The owner was arrested in 2019, and someone made a collection of files he shared.).
woz9ts_duxiu 浏览 搜索 志愿者“woz9ts”提供的剩余读秀文件，这些文件不是读秀专有的PDG格式（仍需转换为PDF）。

资源