Metadata restructure

mappings/README.md

@@ -0,0 +1,15 @@
+# Mappings
+
+This folder contains files that map InventoryID to metadata not stored directly in [phoible.csv](../data/phoible.csv).
+
+- [InventoryID-LanguageCodes.csv](InventoryID-LanguageCodes.csv): InventoryID, Glottocode, ISO6393. One row per InventoryID.
+- [InventoryID-Bibtex.csv](InventoryID-Bibtex.csv): InventoryID, BibtexKey. An InventoryID can have several citations, so this is one to many.
+- [InventoryID-Filenames.csv](InventoryID-Filenames.csv): InventoryID, Filename, URI. The source document each inventory was drawn from. A few InventoryIDs cite more than one source document and so have more than one row.
+- [phoible-references.bib](phoible-references.bib): BibTeX entries for the keys used in InventoryID-Bibtex.csv.
+
+InventoryID-LanguageCodes.csv used to also carry LanguageName and Source columns. These were dropped since nothing in the aggregation pipeline reads them.
+
+## Known issues
+
+- InventoryID 201 (Arrernte, `aer`) has `NO SOURCE GIVEN` as its literal BibtexKey, a placeholder rather than a real citation. See [raw-data/UPSID/README.md](../raw-data/UPSID/README.md) for details.
+- These InventoryIDs cite more than one source document and have more than one row in InventoryID-Filenames.csv: 1050, 1147, 1273, 1300, 1403, 1446, 1496, 1531, 1554, 1578, 1735.

raw-data/EA/README.md

@@ -14,7 +14,7 @@ The raw data and source code are available at: [https://github.com/macleginn/eur
 
 `EA` contains a fresh take on phonological inventories from Eurasia. The data were extracted from grammatical descriptions of individual language varieties. It contains only phonemes, with no information on allophones or linguistic tone.
 
-The data are available in phoible long format in [EA_inventories.tsv](EA_inventories.tsv). We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176) as specified in the [EA_IPA_correspondences.tsv](EA_IPA_correspondences.tsv) correspondences file. We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
+The data are available in phoible long format in [EA_inventories.tsv](EA_inventories.tsv). We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176) as specified in the [EA_IPA_correspondences.tsv](EA_IPA_correspondences.tsv) correspondences file. We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
 
 Note that the ISO 639-3 codes in the EA source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).
 

raw-data/ER/README.md

@@ -13,7 +13,7 @@ Notes on the inventories and their compilation from Erich are below. See also:
 The data
 are available in phoible long format in
 [ER_inventories.tsv](ER_inventories.tsv) and contain only phonemes, with no
-information on allophones or linguistic tone. We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details. For up-to-date language codes for each inventory, we maintain a phoible index here:
+information on allophones or linguistic tone. We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details. For up-to-date language codes for each inventory, we maintain a phoible index here:
 [InventoryID-LanguageCodes.csv](../../mappings/InventoryID-LanguageCodes.csv).
 
 

raw-data/PH/README.md

@@ -12,7 +12,7 @@ The inventory data in [UZ_inventories.tsv](UZ_inventories.tsv) were added by mem
 
 All data in `PH` adhere to the [phoible conventions](https://phoible.org/conventions) and [Unicode IPA](http://langsci-press.org/catalog/book/176). For more information, see the [phoible FAQ](https://phoible.org/faq).
 
-We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
+We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
 
 Note that the ISO 639-3 codes in the PH source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).
 

raw-data/RA/README.md

@@ -6,7 +6,7 @@ The `RA` folder contains data from:
 
 and was compiled by the phoible developers. The data are available in phoible wide format in [Ramaswami1999.tsv](Ramaswami1999.tsv) and contain only phonemes, with no information on allophones or linguistic tone.
 
-We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176). We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
+We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176). We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
 
 Note that the ISO 639-3 codes in the RA source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).
 

raw-data/SAPHON/README.md

@@ -10,7 +10,7 @@ The data are available in phoible wide format in the [saphon20121031.tsv](saphon
 
 We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176) as specified in the [saphon_ipa_correspondences.tsv](saphon_ipa_correspondences.tsv) correspondences file.
 
-We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details. 
+We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details. 
 
 Note that the ISO 639-3 codes in the SAPHON source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).
 

raw-data/SPA/README.md

@@ -12,7 +12,7 @@ The data are available in phoible long format in [SPA_Phones.tsv](SPA_Phones.tsv
 
 We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176) as described in the [SPA_IPA_correspondences.tsv](SPA_IPA_correspondences.tsv) file.
 
-We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
+We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
 
 Note that the ISO 639-3 codes in the SPA source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).
 

raw-data/UPSID/README.md

@@ -13,7 +13,7 @@ The data are available in several files in this directory from the original ASCI
 
 We have converted IPA symbols in the raw data in line with the [phoible conventions](http://phoible.github.io/conventions/) and [Unicode IPA](http://langsci-press.org/catalog/book/176) as described in the [UPSID_IPA_correspondences.tsv](UPSID_IPA_correspondences.tsv) file.
 
-We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../data/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
+We have also collected for each citation a BibTeX reference, available in the [phoible-references.bib](../../mappings/phoible-references.bib) file. See the [InventoryID-Bibtex.csv](../../mappings/InventoryID-Bibtex.csv) mapping file for details.
 
 Note that the ISO 639-3 codes in the UPSID source may be out of date with the current ISO 639-3 standard. For more info, see: [https://iso639-3.sil.org/](https://iso639-3.sil.org/).