Japanese survey - #394
Merged
Merged
Japanese survey#394
Conversation
Splits responses into demographics and substance CSVs (no open-ended free text, no full timestamp) so individual rows cannot be joined back into a single respondent record.
Contributor
Author
|
Long overdue I created a new PR for this that should solve the issues @ymotongpoo raised. FYI @E-STAT |
Contributor
Author
|
@danielgblanco I added you as a reviewer since you commented in the previous PR. Please take a look. I think it should be OK now. |
|
@AndrejKiri Thanks, Andrej. Now I think it got anonymized enough to publish. |
danielgblanco
approved these changes
Sep 4, 2026
danielgblanco
left a comment
danielgblanco
left a comment
Contributor
There was a problem hiding this comment.
Thanks @ymotongpoo for the input. LGTM!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the Japanese community survey to the repo — a README and the response data, split across two CSVs.
This replaces #273, which was opened directly against upstream with the raw, unsplit response data (full timestamps, all answers joined per row, including open-ended free text). That's a re-identification risk for a 114-response survey, so this PR anonymizes the data before it goes in:
japanese-community-survey-demographics.csv— who-they-are fields (region, team type, company size, industry, vendor), with the timestamp reduced to day-only granularity (no time-of-day)japanese-community-survey-substance.csv— OTel usage/opinion fields (familiarity, signals, collector distro, languages, NPS, adoption barriers, events, info sources, vendor), with no timestamp at allThe vendor question is intentionally duplicated in both files to allow filtering on it in either context. Row order between the two files is independently shuffled, so a respondent's row in one file can't be matched to their row in the other by position. All free-text open-ended answers were dropped entirely, since they carried the highest re-identification risk. The original unsplit CSV is not included.
#273 should be closed once this merges.