Files
logpile/bible-local/06-parsers.md
Mikhail ChusavitinandClaude Opus 5.5 cb2e38223e chore: update parser module to v38.0.0, script parser bumps
Move logpile to git.mchus.pro/reanimator/parser/v38 v38.0.0 (ADL-085).
Add scripts/bump-parser.sh, which bumps the parser, tests, commits, tags
the release as v<counter>.<parser major>, pushes and builds (ADL-086).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-26 18:07:28 +03:00

4.4 KiB

06 — Parsers

Parsers live in a separate module

All archive/vendor-format parsing and the Redfish raw-payload replay/analysis engine live in git.mchus.pro/reanimator/parser/v38 (a plain Go module dependency, see ADL-2026-10-08). logpile does not implement or register parsers itself anymore.

The dependency is pinned to a published release (exact version in go.mod; ADL-084, ADL-085, ADL-086), without a local parser replacement. This includes Lenovo XCC mini-log and full FFDC .tzz archives, binary component journals, Linux service journals and structured component activity with historical identities and firmware. Existing PAX tar.gz, nvidia-smi inventory and Inspur audit support are retained. Reopen stored archives to apply the updated parsing behavior.

The module supplies supported file extensions and registered parser versions to /api/file-types and /api/parsers; upload and batch conversion use those capabilities directly. Lenovo diagnostic/configuration evidence remains in raw_payloads.lenovo_xcc; structured component activities remain on the shared AnalysisResult.events model. Historical components do not become current hardware inventory.

The vendor coverage matrix, detection rules, per-vendor data-quality notes, and the VendorParser contract are documented in that repository's own bible-local/ (06-parsers.md equivalent, decisions log) — read it there, not here, when working on parsing/interpretation behavior. This file only covers the boundary: what logpile owns, what it hands to the module, and what comes back.

What logpile still owns

  • Live BMC/Redfish collection (internal/collector/redfish.go): crawling, HTTP session handling, prefetch/recovery, telemetry — everything that talks to a real BMC.
  • Acquisition-time tuning (internal/collector/redfishprofile/): CollectSignals, MatchProfiles, BuildAcquisitionPlan, ResolveAcquisitionPlan decide worker counts, which paths to prefetch, and retry/post-probe policy during the crawl. This package also still carries ApplyAnalysisProfiles/PostAnalyze and their supporting types, which are now unreachable in logpile (that half of the package is exercised only inside the parser module's own copy) — left in place rather than split out, since the package's Profile interface bundles both concerns and splitting it would just duplicate work already done once on extraction.
  • The web server, DB layer, exporter, and UI/visualization.
  • A small local dedup/scoring helper set in internal/collector/redfish_dedup.go (dedupeRedfishPaths, redfishHostSystemScore, lastRedfishPathSegment) — generic utilities the live crawler needs directly; also present inside the parser module's own copy of the same logic, intentionally duplicated rather than shared, since the module does not expose internal packages.

What the module owns and how logpile calls it

Two entry points on git.mchus.pro/reanimator/parser/v38's Service:

  • Service.AnalyzeArchivePayload(filename string, payload []byte) (*models.AnalysisResult, string, error) — uploaded archive parsing. Used by internal/server/handlers.go (upload flow) and cmd/logpile-cpu-audit.
  • Service.AnalyzeRedfishRawPayloads(rawPayloads map[string]any, meta RedfishSourceMetadata) (*models.AnalysisResult, string, error) — the single call at the end of RedfishConnector.Collect() (internal/collector/redfish.go): the crawl builds a raw rawPayloads tree (redfish_tree, redfish_profiles, redfish_telemetry, redfish_fetch_errors, redfish_log_entries, redfish_debug_payloads), then hands it to the module for the actual doc-to-model interpretation. This same call point also serves raw Redfish-tree archive imports (live_redfish source in handlers.go), so live collection and offline raw-tree import share one analyzer, one interpretation.

Top-level helpers also used directly: ListParsersInfo(), IsSupportedArchiveFilename(), SupportedArchiveExtensions(), ParseInDefaultArchiveLocation(), PrivacyScanEnabled(), and the pciids package (git.mchus.pro/reanimator/parser/v38/pciids) for PCI vendor/device name lookups in both the live collector and the exporter.

models package

git.mchus.pro/reanimator/parser/v38/models is used directly everywhere in logpile; there is no local internal/models anymore (fully repointed, 2026-10-08). The module's models package is kept strictly additive against what logpile used to define, so this needed no adapter.