Truth Graph: Introducing Levels by felicepantaleo · Pull Request #51716 · cms-sw/cmssw

felicepantaleo · 2026-08-16T09:58:26Z

Truth levels stamped on the MC-truth logical graph, so a GEN-SIM-DIGI-RAW production ends with a final, self-describing truth graph. The reco-to-truth association layer will follow in a separate PR. Levels are flags on graph particles: the full history stays navigable, and each level marks the one particle per chain that its denominator counts (for the visible signal final state, the pi0 rather than its two photons).

Commit 1, package policy. Removes the prototype banner from every file that carried it and updates the README: the data model and the levels are now covered by unit tests. No code changes.

Commit 2, SimDataFormats/TruthInfo:

levelFlags bitmask on ParticleData, in the alignment hole so sizeof stays 96 (asserted in a unit test).
ParticleRole (normal / connector / synthetic stand-in), stored as its underlying type like VertexData::role.
Seed pdg ids, reconstructable pdg ids and heavy-flavour seeds recorded on the graph, so every flag is re-derivable from the graph alone.
truth::Graph ClassVersion 4 to 5, truth::ParticleData 3 to 4.

Commit 3, PhysicsTools/TruthInfo, the levels. Every level is an antichain (no member is an ancestor of another); on ttbar, 24% of a kinematics-only selection had another selected particle as an ancestor, which is why a plain cut is not a denominator.

Levels: hard-scatter legs, generator-stable final state, calorimeter boundary, upstream and underlying-event legs, signal resonance and its visible final state (a pi0 is one object, not two photons), parton-initiated jets (no clustering; the jet is the parton's descendant subgraph, exactly two b jets per ttbar event), first b and first c hadron per chain (B* over B; beauty and charm separate because a B decays to a D).
One table declares each level (enum, bit, config name); the lookups, the level list and the cleared mask are derived from it, so adding a level is one row.
Walks descend GEN decay vertices only: a SIM continuation is transport, not decay (a K0S interacting in material yields its GEN pions, never the nuclear secondaries).
The Signal flag uses the same root computation as the selection, restricted to GEN particles of the signal interaction; a preset naming a decay channel cannot stamp a resonance that decayed the other way. No resonance configured means no signal level, not a degenerate one.

PR validation:

Built on CMSSW_20_1_0_pre2; all 9 test suites pass (19 cases in LevelFlags_t), with the association layer absent, so the split is self-contained. Workflow 37634.0 runs end to end on this branch alone.
200 no-PU TenTau events, produced with this branch: 10 signal taus/event, all GEN and signal-interaction. The graph keeps the full decay history (pi0s and their photons, connected); the reconstructableFromSignal denominator marks one entry per chain: 1137 pi0s flagged and none of their photons, no neutrinos, no intermediate resonance (rho, a1) flagged.
10 ttbar PU200 events: all 8 to 12 isHardProcess particles per event belong to the signal interaction, so the flag-driven levels are signal-only in practice; a consumer needing signal-only filters on eventId as the denominator producer does.
Flavour-seeded presets: seeds persisted on the graph, two b hadrons flagged per ttbar event.

@IzaakWN @elenavernazza fyi

cmsbuild · 2026-08-16T09:58:54Z

cms-bot internal usage

cmsbuild · 2026-08-16T10:01:22Z

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50628

There are other open Pull requests which might conflict with changes you have proposed:
- File PhysicsTools/TruthInfo/plugins/TruthBranchCaloAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649
- File PhysicsTools/TruthInfo/plugins/TruthBranchTrackingAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649

Code check has found code style and quality issues which could be resolved by applying following patch(s)

code-format:
https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50628/code-format.patch
e.g. curl -k https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50628/code-format.patch | patch -p1
You can also run scram build code-format to apply code format directly

cmsbuild · 2026-08-16T10:30:12Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50629

There are other open Pull requests which might conflict with changes you have proposed:
- File PhysicsTools/TruthInfo/plugins/TruthBranchCaloAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649
- File PhysicsTools/TruthInfo/plugins/TruthBranchTrackingAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649

cmsbuild · 2026-08-16T10:30:43Z

A new Pull Request was created by @felicepantaleo for master.

It involves the following packages:

PhysicsTools/TruthInfo (generators)
SimDataFormats/TruthInfo (generators)

@cmsbuild, @lviliani, @mkirsano, @sensrcn, @theofil can you please review it and eventually sign? Thanks.
@apsallid, @bsunanda, @denizsun, @fabiocos, @martinamalberti, @missirol, @mmusich, @rovere, @salimcerci this is something you requested to watch as well.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

felicepantaleo · 2026-08-16T10:37:13Z

please test

cmsbuild · 2026-08-16T12:59:14Z

+1

Size: This PR adds an extra 288KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fcf517/55383/summary.html
COMMIT: def3d28
CMSSW: CMSSW_20_1_X_2026-08-16-0000/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/51716/55383/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3591807
DQMHistoTests: Total failures: 4
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3591785
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 163 edm output root files, 45 DQM output files
TriggerResults: no differences found

cmsbuild · 2026-08-17T06:21:16Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50633

There are other open Pull requests which might conflict with changes you have proposed:
- File PhysicsTools/TruthInfo/plugins/TruthBranchCaloAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649
- File PhysicsTools/TruthInfo/plugins/TruthBranchTrackingAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649

cmsbuild · 2026-08-20T20:51:40Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50682

There are other open Pull requests which might conflict with changes you have proposed:
- File PhysicsTools/TruthInfo/plugins/TruthBranchCaloAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649
- File PhysicsTools/TruthInfo/plugins/TruthBranchTrackingAssociationProducer.cc modified in PR(s): Rename SimDataformats TICL associator as TICLAssociationMap #51649

cmsbuild · 2026-08-20T20:52:10Z

Pull request #51716 was updated. @cmsbuild, @lviliani, @mkirsano, @sensrcn, @theofil can you please check and sign again.

felicepantaleo · 2026-08-21T03:59:25Z

please test

cmsbuild · 2026-08-21T05:53:11Z

+1

Size: This PR adds an extra 56KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fcf517/55487/summary.html
COMMIT: 3d45d2a
CMSSW: CMSSW_20_1_X_2026-08-20-2300/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/51716/55487/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3592269
DQMHistoTests: Total failures: 21
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3592230
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 163 edm output root files, 45 DQM output files
TriggerResults: no differences found

…utions The data model and the levels are covered by unit tests, so the prototype banner that closed the packages to external changes comes off every file that carried it.

cmsbuild · 2026-08-24T14:12:21Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-51716/50709

cmsbuild · 2026-08-24T14:12:48Z

Pull request #51716 was updated. @cmsbuild, @lviliani, @mkirsano, @sensrcn, @theofil can you please check and sign again.

felicepantaleo · 2026-08-25T12:05:01Z

@cmsbuild please test

cmsbuild · 2026-08-25T13:50:48Z

+1

Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-fcf517/55538/summary.html
COMMIT: c7bcd9c
CMSSW: CMSSW_20_1_X_2026-08-25-1100/el9_amd64_gcc14
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/51716/55538/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3592269
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3592248
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 163 edm output root files, 45 DQM output files
TriggerResults: no differences found

IzaakWN · 2026-09-02T09:51:56Z

@felicepantaleo, is this ready to reviewed & merged? It would great to have if it can still make it for CMSSW_20_1_0_pre3, so we can use if for the PF tutorial during CMS Week.

theofil · 2026-09-02T10:45:41Z

+1

cmsbuild · 2026-09-02T10:46:04Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @ftenchini, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

mandrenguyen · 2026-09-03T06:50:48Z

+1

cmsbuild added this to the CMSSW_20_1_X milestone Aug 16, 2026

cmsbuild added generators-pending pending-signatures tests-pending orp-pending code-checks-pending changes-dataformats labels Aug 16, 2026

cmsbuild added code-checks-rejected and removed code-checks-pending labels Aug 16, 2026

felicepantaleo force-pushed the truth-levels-v1 branch from 55e19f5 to def3d28 Compare August 16, 2026 10:27

cmsbuild added code-checks-pending and removed code-checks-rejected labels Aug 16, 2026

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 16, 2026

cmsbuild added tests-started and removed tests-pending labels Aug 16, 2026

cmsbuild added tests-approved and removed tests-started labels Aug 16, 2026

felicepantaleo force-pushed the truth-levels-v1 branch from def3d28 to 5e70f20 Compare August 17, 2026 06:18

cmsbuild added tests-pending code-checks-pending and removed tests-approved code-checks-approved labels Aug 17, 2026

cmsbuild added tests-pending code-checks-pending labels Aug 20, 2026

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 20, 2026

cmsbuild added tests-started and removed tests-pending labels Aug 21, 2026

cmsbuild added tests-approved and removed tests-started labels Aug 21, 2026

felicepantaleo added 3 commits August 24, 2026 16:08

PhysicsTools, SimDataFormats/TruthInfo: open the packages for contrib…

4b6e76d

…utions The data model and the levels are covered by unit tests, so the prototype banner that closed the packages to external changes comes off every file that carried it.

SimDataFormats/TruthInfo: level flags, particle roles and recorded seeds

82c3012

PhysicsTools/TruthInfo: truth levels stamped on the logical graph

c7bcd9c

felicepantaleo force-pushed the truth-levels-v1 branch from 3d45d2a to c7bcd9c Compare August 24, 2026 14:10

cmsbuild removed tests-approved code-checks-approved labels Aug 24, 2026

This was referenced Sep 3, 2026

Massive update of Python Packages cms-sw/cmsdist#10821

Merged

md5.h rename to edm_md5 to avoid collision #51818

Merged

md5: To avoid collision: rename md5.h to edm_md5 cms-sw/cmsdist#10825

Merged

felicepantaleo mentioned this pull request Sep 4, 2026

Truth Graph: branch association library and reco-to-truth associators #51829

Open

Uh oh!

Conversation

felicepantaleo commented Aug 16, 2026

PR validation:

Uh oh!

cmsbuild commented Aug 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Aug 16, 2026

Uh oh!

cmsbuild commented Aug 16, 2026

Uh oh!

cmsbuild commented Aug 16, 2026

Uh oh!

felicepantaleo commented Aug 16, 2026

Uh oh!

cmsbuild commented Aug 16, 2026

Comparison Summary

Uh oh!

cmsbuild commented Aug 17, 2026

Uh oh!

cmsbuild commented Aug 20, 2026

Uh oh!

cmsbuild commented Aug 20, 2026

Uh oh!

felicepantaleo commented Aug 21, 2026

Uh oh!

cmsbuild commented Aug 21, 2026

Comparison Summary

Uh oh!

cmsbuild commented Aug 24, 2026

Uh oh!

cmsbuild commented Aug 24, 2026

Uh oh!

felicepantaleo commented Aug 25, 2026

Uh oh!

cmsbuild commented Aug 25, 2026

Comparison Summary

Uh oh!

IzaakWN commented Sep 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

theofil commented Sep 2, 2026

Uh oh!

cmsbuild commented Sep 2, 2026

Uh oh!

mandrenguyen commented Sep 3, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

cmsbuild commented Aug 16, 2026 •

edited

Loading

IzaakWN commented Sep 2, 2026 •

edited

Loading