diff --git a/bible-local/10-decisions.md b/bible-local/10-decisions.md index 50ff0bd..0fb72f5 100644 --- a/bible-local/10-decisions.md +++ b/bible-local/10-decisions.md @@ -2101,3 +2101,32 @@ X to Y` records only, emitted as Info events of type `Component Replace` with - Installation is not written to `status_history`: that field carries health statuses only, and the BMC logs the SN change after POST, i.e. after a POR mapout of the same module. + +--- + +## ADL-072 — Reanimator event_logs: no invented event_time, is_active from snapshots only + +**Date:** 2026-09-28 +**Context:** Contract v2.13 `event_logs[]` has optional `event_time` (Reanimator +falls back to collection/ingest time) and `is_active` ("still active / not +cleared"). The exporter filled `event_time` with `collected_at` and never set +`is_active`; component.log snapshot events were exported as `source=host`. + +**Decision:** `event_time` is omitted when the event has no source time. +`is_active` is `true` only from an authoritative active-alarm snapshot: +Inspur `dev_status.log` (matched by IDL event ID or SEL sensor at the same +instant) and component.log fan state (`models.Event.Active`). It is `false` for +Deasserts and for Asserts superseded within a real Assert/Deassert lifecycle, +and for Inspur Warning/Critical Asserts missing from `dev_status.log`. +Otherwise it is unset. A latest Assert with no logged Deassert is not assumed +active: AC loss and BMC resets drop Deasserts (24C319575: PSU1 predictive +failure never deasserted, absent from `dev_status.log`). component.log fan +events use source `BMC`. + +**Consequences:** +- Snapshot-state events are exported without `event_time` and with + `is_active=true`. +- Installation time from `maintenance.log` cannot be passed to the Reanimator + timeline under v2.13; contract change requested in + `docs/reanimator-contract-request-installed-at.md`, follow-up in BACKLOG + `[installed_at]`. diff --git a/bible-local/BACKLOG.md b/bible-local/BACKLOG.md index be9bd73..fd060d2 100644 --- a/bible-local/BACKLOG.md +++ b/bible-local/BACKLOG.md @@ -1,5 +1,23 @@ # Backlog +## [installed_at] Экспорт времени установки компонента в Reanimator + +**Приоритет:** средний. **Блокер:** правка контракта Reanimator, см. +`docs/reanimator-contract-request-installed-at.md` (status: proposed). + +**Контекст:** Inspur `maintenance.log` хранит `Component Replace SN changed from X to Y` +с точным временем. С 2026-09-28 LOGPile разбирает эти записи в события +(`inspur/maintenance.go`), но контракт v2.13 не позволяет передать их как время +установки: `status_history` принимает только статусы, а `event_logs` не +попадает в timeline. + +**Что сделать после принятия контракта:** +1. Модель: `InstalledAt *time.Time` в компонентных структурах (`models.go`). +2. Inspur: заполнять по последней записи `Component Replace`, у которой слот + и новый SN совпадают с компонентом; при несовпадении SN не ставить. +3. Экспорт: `installed_at` в `reanimator_models.go` / `reanimator_converter.go`. +4. Обновить зеркало `docs/hardware-ingest-contract.md`. + ## [sfp_modules] Поддержка per-port SFP/QSFP модулей в экспорте Reanimator **Приоритет:** низкий (до выхода Reanimator v3.0, пока deprecated sfp_* скаляры ещё принимаются) diff --git a/bible-local/docs/reanimator-contract-request-installed-at.md b/bible-local/docs/reanimator-contract-request-installed-at.md new file mode 100644 index 0000000..36f8df3 --- /dev/null +++ b/bible-local/docs/reanimator-contract-request-installed-at.md @@ -0,0 +1,121 @@ +--- +title: "Запрос на правку контракта: installed_at у компонентов" +target: Reanimator Core — Hardware Ingest JSON Contract (текущая версия 2.13) +requested_by: LOGPile +date: "2026-09-28" +status: proposed +--- + +# Запрос на правку контракта: `installed_at` у компонентов + +## Проблема + +`COMPONENT_INSTALLED` / `REMOVED` / `COMPONENT_CHANGED` Reanimator выводит сам, +сравнивая снимки при ingest, и датирует их временем ingest/`collected_at`. +Но BMC часто хранят точное историческое время установки или замены +компонента, и сейчас передать его некуда: + +- `status_history[]` принимает только статусы здоровья + (`OK`/`Warning`/`Critical`/`Unknown`/`Empty`). Установка — не смена статуса, + а `Unknown` создал бы ложный `COMPONENT_UNKNOWN`. +- `event_logs[]` время сохраняет, но по контракту «не попадают в history + timeline и не изменяют canonical state». Запись об установке там видна как + лог, но на timeline её нет. + +В результате при первом импорте дампа, снятого через недели после работ, +установка на timeline датируется днём импорта. Кроме того, на ненадёжную +дату опирается `parts.first_seen_at`. + +## Пример из реального источника + +Inspur/Kaytus onekeylog, `log/maintenance.log` и ротированный +`maintenance.log.1.gz`. Запись пишется только туда, в IDL/SEL её нет: + +``` +|2026-08-12T15:35:22+08:00|MEMORY|Assert|Info|0CFFB300|Component Replace DIMM021 SN changed from NULL to H0KN000308444EA65D! - Assert| +|2024-03-22T17:09:44+08:00|CPU|Assert|Info|07FFB000|Component Replace CPU0 changed from NULL to 23300E51079AF0AB! - Assert| +|2024-03-22T16:57:31+08:00|PSU|Assert|Info|08FFB100|Component Replace PSU0 SN changed from NULL to 2O01C154658! - Assert| +``` + +Сервер 24C319575, дамп снят 2026-08-13. В нём видна исходная сборка +2024-03-22 (CPU, PSU, 12 DIMM) и добавление 19 DIMM 2026-08-12 в 15:35 +08. +Три из этих DIMM BIOS отключает при каждом POST (POR Mapout). Для разбора +отказа важно, что модули поставлены в этот день, а не пришли с машиной. +Сейчас Reanimator покажет их установку датой импорта. + +Такие же данные есть у других источников: Redfish `LogEntry` с +`MessageId` вида `*.ComponentInstalled`/`*.Replaced`, журнал Lifecycle +Controller у Dell, IML у HPE. + +## Предложение + +Добавить общее необязательное поле компонентных секций (`cpus`, `memory`, +`storage`, `pcie_devices`, `power_supplies`) в раздел +«Общие поля статуса компонентов»: + +| Поле | Тип | Описание | +|------|-----|----------| +| `installed_at` | string RFC3339 | Время, когда источник зафиксировал установку этого экземпляра компонента (по `serial_number`) в текущий `slot`. Передаётся, только если источник хранит такую запись | + +### Семантика на стороне Reanimator + +1. **Время `COMPONENT_INSTALLED`.** Если ingest обнаруживает новую установку + компонента в слот и `installed_at` передан, событие датируется + `installed_at`, а не временем ingest. Это продолжает правило + «Use component event time over ingest time whenever possible». +2. **Замена в слоте.** Если в тот же `machine + slot` ранее был установлен + другой компонент, его `REMOVED` датируется тем же `installed_at`: BMC + фиксирует замену одной записью (SN A → B). +3. **`first_seen_at`.** `installed_at` становится ещё одним кандидатом в + «First Seen Rules» (минимум из кандидатов). +4. **Не влияет на статус.** Как и прочие non-status события, `installed_at` + не меняет health. +5. **Валидация.** + - `installed_at` позже `collected_at` → поле игнорируется, с предупреждением + в `summary`. + - `installed_at` раньше `collected_at` предыдущего ingest, в котором + компонента в этом слоте не было → противоречие; поле игнорируется, + остаётся текущее поведение. +6. **Повторный импорт того же `installed_at`** — no-op. Изменившийся + `installed_at` для уже открытой установки — коррекция времени по аналогии + с `COMPONENT_FIRST_SEEN_CORRECTED`, без повторного `COMPONENT_INSTALLED`. + +### Правила для интеграторов + +- Не синтезировать: не передавать `installed_at` из `collected_at`, времени + первого появления в логах, времени первого Assert и т.п. Только явная + запись источника об установке или замене именно этого `serial_number`. +- Если записей несколько (переустановка), передавать самую позднюю + установку этого серийника в этот слот. +- Удалённые компоненты в снимке отсутствуют, поэтому их время передаётся + через `installed_at` нового компонента в том же слоте (п. 2). Отдельное + время снятия без замены этим полем не покрывается. Если оно понадобится, + это отдельная секция `component_events[]`, в эту правку не входит. + +### Пример + +```json +"memory": [ + { + "slot": "CPU0_C2D1", + "serial_number": "H0KN000308444EA65D", + "part_number": "M393A8G40BB4-CWE", + "status": "Warning", + "status_changed_at": "2026-08-12T11:23:50Z", + "error_description": "CPU0_C2D1 Memory Device Disabled ... POR Mapout", + "installed_at": "2026-08-12T07:35:22Z" + } +] +``` + +## Changelog-строка (предлагаемая) + +| 2.14 | — | Добавлено общее необязательное поле `installed_at` (RFC3339) для компонентных секций: время установки экземпляра компонента в слот по данным источника; используется для датирования `COMPONENT_INSTALLED`/`REMOVED` при замене и как кандидат `first_seen_at` | + +## Что сделает LOGPile после принятия + +`maintenance.log` уже разбирается: события `Component Replace` с +`component_ref` = слот (`DIMM021` → `CPU0_C2D1`). После выхода версии +контракта с полем экспортёр будет ставить `installed_at` компоненту, у +которого слот и новый `serial_number` совпадают с последней записью +`Component Replace` (см. BACKLOG `[installed_at]`). diff --git a/internal/exporter/reanimator_converter.go b/internal/exporter/reanimator_converter.go index c024510..579d9c4 100644 --- a/internal/exporter/reanimator_converter.go +++ b/internal/exporter/reanimator_converter.go @@ -51,7 +51,7 @@ func ConvertToReanimator(result *models.AnalysisResult) (*ReanimatorExport, erro PCIeDevices: dedupePCIe(convertPCIeFromDevices(devices, collectedAt)), PowerSupplies: disambiguatePSUSlots(dedupePSUs(convertPSUsFromDevices(devices, collectedAt))), Sensors: convertSensors(result.Sensors), - EventLogs: convertEventLogs(result.Events, collectedAt), + EventLogs: convertEventLogs(result.Events), Licenses: dedupeLicenses(convertLicenses(result.Hardware.Licenses, collectedAt)), }, } @@ -1253,13 +1253,14 @@ func convertPSUsFromDevices(devices []models.HardwareDevice, collectedAt string) return result } -func convertEventLogs(events []models.Event, collectedAt string) []ReanimatorEventLog { +func convertEventLogs(events []models.Event) []ReanimatorEventLog { if len(events) == 0 { return nil } + activeByIndex := deriveEventLogActive(events) out := make([]ReanimatorEventLog, 0, len(events)) - for _, event := range events { + for i, event := range events { source := normalizeEventLogSource(event.Source) message := strings.TrimSpace(event.Description) if source == "" || message == "" { @@ -1268,11 +1269,12 @@ func convertEventLogs(events []models.Event, collectedAt string) []ReanimatorEve item := ReanimatorEventLog{ Source: source, - EventTime: formatEventLogTime(event.Timestamp, collectedAt), + EventTime: formatEventLogTime(event.Timestamp), Severity: normalizeEventLogSeverity(event.Severity), MessageID: strings.TrimSpace(event.ID), Message: message, ComponentRef: firstNonEmptyString(strings.TrimSpace(event.SensorName), strings.TrimSpace(event.SensorType)), + IsActive: activeByIndex[i], } if raw := strings.TrimSpace(event.RawData); raw != "" { item.RawPayload = map[string]any{ @@ -1494,11 +1496,94 @@ func normalizeEventLogSeverity(severity models.Severity) string { } } -func formatEventLogTime(ts time.Time, collectedAt string) string { - if !ts.IsZero() { - return ts.UTC().Format(time.RFC3339) +// formatEventLogTime leaves event_time empty when the source gave no time: +// the contract makes Reanimator fall back to collection/ingest time itself, +// so the export must not pass collection time off as the event time. +func formatEventLogTime(ts time.Time) string { + if ts.IsZero() { + return "" } - return strings.TrimSpace(collectedAt) + return ts.UTC().Format(time.RFC3339) +} + +// deriveEventLogActive fills event_logs[].is_active. An explicit +// models.Event.Active (set by a parser from an authoritative active-alarm +// snapshot) wins. Otherwise only "inactive" is derived: within a condition +// that has real Assert/Deassert lifecycle, every Deassert and every Assert +// followed by a later record is inactive. The latest Assert stays unknown: +// a missing Deassert does not prove the condition still holds (BMC resets +// and AC loss drop Deasserts), and the contract forbids synthesizing it. +func deriveEventLogActive(events []models.Event) map[int]*bool { + out := make(map[int]*bool, len(events)) + groups := make(map[string][]int) + for i, event := range events { + if event.Active != nil { + v := *event.Active + out[i] = &v + continue + } + key, ok := eventLifecycleKey(event) + if !ok || event.Timestamp.IsZero() { + continue + } + groups[key] = append(groups[key], i) + } + for _, idx := range groups { + hasDeassert := false + latest := idx[0] + for _, i := range idx { + if eventLifecyclePhase(events[i]) == "deassert" { + hasDeassert = true + } + if !events[i].Timestamp.Before(events[latest].Timestamp) { + latest = i + } + } + if !hasDeassert { + continue + } + for _, i := range idx { + if i == latest && eventLifecyclePhase(events[i]) == "assert" { + continue + } + inactive := false + out[i] = &inactive + } + } + return out +} + +func eventLifecycleKey(event models.Event) (string, bool) { + if eventLifecyclePhase(event) == "" { + return "", false + } + sensor := strings.ToLower(strings.TrimSpace(event.SensorName)) + if sensor == "" { + return "", false + } + // IDL-style records keep the condition in the message ID and put the + // phase in EventType; SEL-style records keep the condition in EventType. + condition := strings.ToLower(strings.TrimSpace(event.EventType)) + if condition == "assert" || condition == "deassert" || condition == "asserted" || condition == "deasserted" { + condition = strings.ToLower(strings.TrimSpace(event.ID)) + } + if condition == "" { + return "", false + } + return normalizeEventLogSource(event.Source) + "|" + strings.ToLower(strings.TrimSpace(event.SensorType)) + "|" + sensor + "|" + condition, true +} + +func eventLifecyclePhase(event models.Event) string { + for _, s := range []string{event.EventType, event.RawData} { + lower := strings.ToLower(s) + switch { + case strings.Contains(lower, "deassert"): + return "deassert" + case strings.Contains(lower, "assert"): + return "assert" + } + } + return "" } func manufacturedYearWeekFromDetails(details map[string]any) string { diff --git a/internal/exporter/reanimator_event_logs_test.go b/internal/exporter/reanimator_event_logs_test.go new file mode 100644 index 0000000..639d53c --- /dev/null +++ b/internal/exporter/reanimator_event_logs_test.go @@ -0,0 +1,50 @@ +package exporter + +import ( + "testing" + "time" + + "git.mchus.pro/mchus/logpile/internal/models" +) + +func TestConvertEventLogs_UndatedEventHasNoEventTime(t *testing.T) { + logs := convertEventLogs([]models.Event{{Source: "BMC", Description: "FAN3 reports Critical"}}) + if len(logs) != 1 { + t.Fatalf("expected 1 log, got %d", len(logs)) + } + if logs[0].EventTime != "" { + t.Fatalf("event without source time must not get collection time, got %q", logs[0].EventTime) + } +} + +func TestConvertEventLogs_IsActive(t *testing.T) { + t0 := time.Date(2026, 8, 12, 10, 0, 0, 0, time.UTC) + yes := true + events := []models.Event{ + // 0..2: condition with lifecycle, latest Assert still open. + {Timestamp: t0, Source: "BMC", SensorType: "memory", SensorName: "CPU0_C2D1", ID: "0C090401", EventType: "Assert", Description: "disabled"}, + {Timestamp: t0.Add(time.Minute), Source: "BMC", SensorType: "memory", SensorName: "CPU0_C2D1", ID: "0C090401", EventType: "Deassert", Description: "disabled"}, + {Timestamp: t0.Add(2 * time.Minute), Source: "BMC", SensorType: "memory", SensorName: "CPU0_C2D1", ID: "0C090401", EventType: "Assert", Description: "disabled"}, + // 3: one-shot Assert without lifecycle. + {Timestamp: t0, Source: "BMC", SensorType: "sys restart", SensorName: "SYS RESTART", ID: "1D020000", EventType: "Assert", Description: "restart"}, + // 4: explicit snapshot state. + {Source: "BMC", SensorType: "fan", SensorName: "FAN3", EventType: "Fan Status", Description: "FAN3 reports Critical", Active: &yes}, + // 5: SEL-style record: condition in EventType, phase in RawData. + {Timestamp: t0, Source: "SEL", SensorType: "power supply", SensorName: "PSU0_Status", ID: "10", EventType: "Predictive failure", RawData: "Asserted", Description: "Predictive failure"}, + {Timestamp: t0.Add(time.Minute), Source: "SEL", SensorType: "power supply", SensorName: "PSU0_Status", ID: "15", EventType: "Predictive failure", RawData: "Deasserted", Description: "Predictive failure"}, + } + + logs := convertEventLogs(events) + want := []*bool{ptrBool(false), ptrBool(false), nil, nil, ptrBool(true), ptrBool(false), ptrBool(false)} + for i, w := range want { + got := logs[i].IsActive + switch { + case w == nil && got != nil: + t.Fatalf("log %d: expected is_active unset, got %v", i, *got) + case w != nil && (got == nil || *got != *w): + t.Fatalf("log %d: expected is_active=%v, got %v", i, *w, got) + } + } +} + +func ptrBool(v bool) *bool { return &v } diff --git a/internal/models/models.go b/internal/models/models.go index 933a2d7..286e520 100644 --- a/internal/models/models.go +++ b/internal/models/models.go @@ -98,6 +98,10 @@ type Event struct { Severity Severity `json:"severity"` Description string `json:"description"` RawData string `json:"raw_data,omitempty"` + // Active is set when the source states the condition still held at + // collection (snapshot state). Nil means unknown; exporters then derive + // it from Assert/Deassert lifecycle when possible. + Active *bool `json:"active,omitempty"` } // Severity represents event severity level diff --git a/internal/parser/vendors/inspur/active_alarms.go b/internal/parser/vendors/inspur/active_alarms.go new file mode 100644 index 0000000..dfbfc1d --- /dev/null +++ b/internal/parser/vendors/inspur/active_alarms.go @@ -0,0 +1,62 @@ +package inspur + +import ( + "strings" + + "git.mchus.pro/mchus/logpile/internal/models" +) + +// applyActiveFromDeviceStatus marks journal alarms with the BMC's own +// active-alarm snapshot (dev_status.log, taken at log collection). A +// Warning/Critical Assert listed there is active; one missing from it is +// not, even without a logged Deassert (AC loss or a BMC reset drops those). +// Info-level asserts are one-shot notifications and stay unmarked. +func applyActiveFromDeviceStatus(events, current []models.Event) { + type activeAlarm struct { + id string + sensor string + } + bySecond := make(map[int64][]activeAlarm) + for _, alarm := range current { + if alarm.Timestamp.IsZero() || eventIsDeassert(alarm) { + continue + } + sec := alarm.Timestamp.Unix() + bySecond[sec] = append(bySecond[sec], activeAlarm{ + id: strings.ToUpper(strings.TrimSpace(alarm.ID)), + sensor: strings.ToUpper(strings.TrimSpace(alarm.SensorName)), + }) + } + + for i := range events { + event := &events[i] + if event.Active != nil || event.Timestamp.IsZero() || !isAlarmSeverity(event.Severity) { + continue + } + source := strings.ToUpper(strings.TrimSpace(event.Source)) + if source != "BMC" && source != "SEL" { + continue + } + if eventIsDeassert(*event) { + continue + } + active := false + id := strings.ToUpper(strings.TrimSpace(event.ID)) + sensor := strings.ToUpper(strings.TrimSpace(event.SensorName)) + for _, alarm := range bySecond[event.Timestamp.Unix()] { + // IDL records match by event ID; SEL records carry a record + // number instead and match by sensor name at the same instant. + if (source == "BMC" && id == alarm.id) || + (source == "SEL" && sensor != "" && alarm.sensor != "" && + (strings.Contains(sensor, alarm.sensor) || strings.Contains(alarm.sensor, sensor))) { + active = true + break + } + } + event.Active = &active + } +} + +func isAlarmSeverity(severity models.Severity) bool { + return severity == models.SeverityWarning || severity == models.SeverityCritical +} diff --git a/internal/parser/vendors/inspur/active_alarms_test.go b/internal/parser/vendors/inspur/active_alarms_test.go new file mode 100644 index 0000000..ad06f73 --- /dev/null +++ b/internal/parser/vendors/inspur/active_alarms_test.go @@ -0,0 +1,38 @@ +package inspur + +import ( + "testing" + "time" + + "git.mchus.pro/mchus/logpile/internal/models" +) + +func TestApplyActiveFromDeviceStatus(t *testing.T) { + loc := time.FixedZone("+08", 8*3600) + mapout := time.Date(2026, 8, 12, 19, 23, 50, 0, loc) + psu := time.Date(2026, 8, 11, 19, 8, 50, 0, loc) + events := []models.Event{ + {Timestamp: mapout, Source: "BMC", SensorName: "CPU0_C2D1", ID: "0C090401", EventType: "Assert", Severity: models.SeverityWarning}, + {Timestamp: mapout, Source: "SEL", SensorName: "CPU0_C2D1", ID: "69", EventType: "Memory Device Disabled", RawData: "Asserted", Severity: models.SeverityWarning}, + {Timestamp: psu, Source: "BMC", SensorName: "PSU1", ID: "08010201", EventType: "Assert", Severity: models.SeverityWarning}, + {Timestamp: psu, Source: "BMC", SensorName: "PSU1", ID: "08010000", EventType: "Assert", Severity: models.SeverityInfo}, + } + current := []models.Event{ + {Timestamp: mapout, Source: "BMC", SensorName: "CPU0_C2D1", ID: "0C090401", EventType: "Assert", Severity: models.SeverityWarning}, + } + + applyActiveFromDeviceStatus(events, current) + + if events[0].Active == nil || !*events[0].Active { + t.Fatalf("IDL alarm listed in dev_status must be active") + } + if events[1].Active == nil || !*events[1].Active { + t.Fatalf("SEL record of the same alarm must be active") + } + if events[2].Active == nil || *events[2].Active { + t.Fatalf("alarm missing from dev_status must be inactive even without Deassert") + } + if events[3].Active != nil { + t.Fatalf("info notification must stay unmarked") + } +} diff --git a/internal/parser/vendors/inspur/component.go b/internal/parser/vendors/inspur/component.go index 1e06b9e..7516e43 100644 --- a/internal/parser/vendors/inspur/component.go +++ b/internal/parser/vendors/inspur/component.go @@ -48,8 +48,8 @@ func ParseComponentLog(content []byte, hw *models.HardwareConfig) { // ParseComponentLogEvents extracts fan state reported in component.log. // It is a snapshot at log collection, not a journal entry: events carry no -// timestamp. DIMM state is not emitted here: it lives on the DIMM itself -// (see applyMemoryStatusFromEvents). +// timestamp and are marked active. DIMM state is not emitted here: it lives +// on the DIMM itself (see applyMemoryStatusFromEvents). func ParseComponentLogEvents(content []byte) []models.Event { return parseFanEvents(string(content)) } @@ -1073,15 +1073,17 @@ func parseFanEvents(text string) []models.Event { severity = models.SeverityCritical } + active := true events = append(events, models.Event{ ID: fmt.Sprintf("fan_%d_status", fan.ID), - Source: "Fan", + Source: "BMC", SensorType: "fan", SensorName: name, EventType: "Fan Status", Severity: severity, Description: fmt.Sprintf("%s reports %s", name, status), RawData: fmt.Sprintf("rpm=%d pct=%d model=%s", fan.SpeedRPM, fan.SpeedPercent, fan.FanModel), + Active: &active, }) } diff --git a/internal/parser/vendors/inspur/parser.go b/internal/parser/vendors/inspur/parser.go index 22300c5..f93ecaf 100644 --- a/internal/parser/vendors/inspur/parser.go +++ b/internal/parser/vendors/inspur/parser.go @@ -326,6 +326,9 @@ func (p *Parser) Parse(files []parser.ExtractedFile) (*models.AnalysisResult, er currentDeviceEvents = ParseIDLLog(f.Content) } applyStorageStatusFromEvents(result.Hardware, result.Events, currentDeviceEvents, currentDeviceSnapshotAvailable) + if currentDeviceSnapshotAvailable { + applyActiveFromDeviceStatus(result.Events, currentDeviceEvents) + } enrichStorageFromSerialFallbackFiles(files, result.Hardware) // Enrich storage serial numbers from smartd output in SOLHostCapture.log. // Fills in serial, model, firmware for backplane slots that the BMC HDD API left empty.