OAM monitoring and reporting

OAM fault and performance tools monitor and report information about the network infrastructure and the services that rely on that infrastructure.

Performance monitoring

Performance monitoring encompasses a variety of tools and protocols designed to measure, report, analyze, and optimize network performance, allowing network administrators to detect and resolve issues proactively. This chapter provides information about delay and loss measurement as part of STAMP OAM performance monitoring.

STAMP OAM performance monitoring

The STAMP OAM performance monitoring architecture for gathering and computing Key Performance Indicators (KPIs) using standard protocols and a robust collection model consists of the following foundational components:

  • session: This is the overall collection of the test parameters, measurement intervals, thresholds and storage of results. It is the overall container that defines the attributes of the session.

  • standard performance monitoring packets: SR Linux supports STAMP to measure performance metrics such as delay and packet loss. See Session sender packet format and Session reflector packet format in the STAMP chapter for more information about STAMP test packets.

  • measurement interval: These are time-based non-overlapping windows that capture results that are received in that window of time.

  • data structures: These are the unique counters and measurement results that represent the specific protocol.

  • bin group: These are ranges in microseconds that count the results that fit into the range.

The following figure shows the hierarchy of the architecture. This figure intends to show the relationship between the components and not to depict all the details of the required parameters.

Figure 2. OAM performance monitoring architecture hierarchy

Session

The session is the overall collection of test information fields. The session can be viewed as the single container that combines all aspects of individual tests and the various OAM performance monitoring components. The session command includes parameters such as:

  • session-type: The session type is either proactive or on-demand. The session type setting influences the individual test timing parameters.

  • test-id: The test identifier is a configured as a numerical value or using the auto keyword. An automatically assigned test identifier is released when the test is deleted. Any action that causes the test to be deleted and recreated releases the original test identifier and allocates a new one. These test identifiers are not persistent and not maintained across CPM switchovers. New test identifiers are allocated in the case of CPM switchover.

  • test parameters: These include start time, stop time, ability to activate a test, and ability to deactivate a test.

  • measurement-interval: This is the assignment of collection windows to the session with the appropriate configuration parameters .

Session types and operational states

The operational state of a session is influenced by:

  • session type

  • session administrative state

In a proactive session, the operational state is up when the administrative state is enabled. The operational state is down when the administrative state is disabled. A proactive test session starts immediately after the oam performance-monitoring ip session stamp admin-state command is set to enable. A proactive test session stops immediately after the oam performance-monitoring ip session stamp admin-state command is set to disable. The operational state of a proactive session mirrors the administrative state of the session.

In an on-demand session, the operational state is up when the administrative state is enabled, and the tools oam performance-monitoring ip session on-demand-action start command is executed. The on-demand test stops after one of the following actions:
  • the completion of the test-duration configured using the oam performance-monitoring ip session session-type on-demand stamp test-duration command

  • the execution of the tools oam performance-monitoring ip session on-demand-action stop command

The operational state of an on-demand sessions is not directly tied to the administrative state. It depends on the initiation and completion of tests.

Standard performance monitoring packets

SR Linux supports STAMP (Simple Two-way Active Measurement Protocol) to measure performance metrics such as delay and packet loss. STAMP defines test packets in two directions:
  • session sender packet. Test request packets that the session sender transmits to the session reflector.

  • session reflector packet. Test response packets that the session reflector sends to the session sender.

See the Standard performance monitoring packets and Session reflector packet format in the STAMP chapter for detailed information about STAMP test packets.

Data structures

There are two main metrics that are the focus of OAM performance monitoring: delay and loss.

Delay metrics
SR Linux supports the following delay metrics:
  • Frame Delay (FD): This measures the time taken for a packet to traverse the network. Any negative FD values are set to zero for binning purposes.

  • Frame Delay Range (FDR): This represents the difference between the FD and the lowest FD recorded within a measurement interval. For the first interval, the minimum delay is set to zero. For subsequent intervals, the minimum delay of the previous measurement interval is used as the reference. Negative FD values are set to zero before calculating FDR.

  • Inter-Frame Delay Variation (IFDV): Also known as jitter, IFDV measures the variation in delay between adjacent test frames. The absolute difference between the current and previous delay values is calculated, even if the previous delay was negative.

FD, FDR, and IFDV are categorized into bins based on the bin group configuration. The minimum, maximum, and average values for each direction (forward, backward, and round-trip) are also reported. Delay threshold events and the last time the threshold crossing alarm (TCA) was triggered are also logged .

By default, the average for all delay metrics includes all the results within the measurement interval. However, it is possible to exclude the measurements using exclude-from-average for a specified direction. The results are binned but the delay values included in the exclude option are not included in the average computation.

Loss metrics

SR Linux supports the following loss metrics:

  • out loss: This metric measures the difference between the packets that the session reflector receives and those that the session sender transmits.

  • in loss: This metric calculates the difference between the packets that the session sender receives and those that the session reflector transmits.

  • Frame Loss Ratio (FLR): This percentage metric represents the ratio of lost packets during times of availability. FLR is not incremented during periods of unavailability.

  • available: The number of delta-ts that are recorded as available. These delta-ts do not exceed the FLR threshold and do not follow an unavailable state. If the available delta-ts follow an unavailable state, they need to fill the availability window before transitioning to available.

  • unavailable: The number of delta-ts that are recorded as unavailable. These delta-ts exceed the FLR threshold and do not follow an available state. If the unavailable delta-ts follow and available state, they need to fill the unavailability window before transitioning to unavailable.

  • undetermined availability: This counter increments when packets are lost and there is no explicit information about the fate of the packet. This occurs after timeouts and follows an available state.

  • undetermined unavailability: Similar to undetermined availability, this counter increments after packet timeouts following an available state when there is no explicit information about the fate of the packet.

  • High Loss Interval (HLI): This increments when individual delta-ts reach or exceed the FLR configuration. By default, this is calculated during the availability periods. Executing the oam performance-monitoring ip session stamp loss hli-force-count command and configuring the true option increments the HLI regardless of the availability state.

  • Consecutive High Loss Interval (CHLI): This increments when consecutive HLI intervals meet or exceed a specified threshold within the sliding window. CHLI increments only a single time for each availability window.

Measurement intervals

A measurement interval is a window of time that compartmentalizes the gathered measurements for an individual test that has occurred during that time. Allocation of measurement intervals, which equates to system memory, is based on the metrics being collected. This means that when both delay and loss metrics are collected, they allocate their own set of measurement intervals.

Duration

The measurement interval durations are as follows:

  • 1-min

  • 5-min

  • 15-min

  • 1-hour

  • 1-day

Boundary type

The boundary-type parameter defines the start of the measurement interval and can be aligned to the local time-of-day clock, with or without an optional offset. By default, the start boundary is clock-aligned without an offset. When this configuration is deployed, the measurement interval establishes non-overlapping time-based windows which complete at the specified time. The boundary-type parameter can be aligned using the test-relative option, which means that the start of the measurement interval coincides with the activation of the test and the length of the measured interval determines the completion.

Clock aligned

When a boundary is clock-aligned and clock-offset option is configured, a specified amount of time is applied to the measurement interval. Offsets are configured on a per-measurement interval basis and only applicable to clock-aligned measurement intervals. Only offsets less than the measurement interval duration are allowed. The following table lists examples of the start times of each measurement interval.

Table 2. Measurement interval start times
Offset 1-min 5-min 15-min 1-hour 1-day

0 (default)

0, 1, 2, 3, ...

00, 05, 10, 15, ...

00, 15, 30, 45

00 (top of the hour)

midnight

10 minutes

rejected

rejected

10, 25, 40, 55

10 min after the hour

10 min after midnight

30 minutes

rejected

rejected

rejected

30 min after the hour

30 min after midnight

60 minutes

rejected

rejected

rejected

rejected

01:00 AM

Test relative

Although test-relative approaches may seem beneficial for simplicity, there are some drawbacks that need to be considered. The goal of the time-based and well-defined collection windows allows for the comparison of measurements across common windows of time throughout the network and for relating different tests or sessions. On-demand tests are typically used for troubleshooting or short term monitoring that does not require alignment or comparison to other performance monitoring data and may make better use of the test-relative boundary.

Intervals stored

The statistical data collected and the computed results from each measurement interval are maintained in volatile system memory. The number of intervals stored is configurable per measurement interval. Different measurement intervals have different defaults and ranges. The interval-stored parameter defines the number of completed individual test runs to store in volatile memory. There is an additional allocation to account for the active measurement interval. If the retained test data for a measurement interval consumes the final entry, any subsequent entries cause the removal of the oldest data.

Threshold events

The following are the two types of threshold events:

  • stateless. The stateless threshold events are:

    • autonomous. Each measurement interval operates independently without carrying forward any information about events from previous intervals.

    • self-contained. The events are evaluated and triggered within the confines of a single measurement interval.

    • enacted when clear-threshold is unset.

  • stateful. The stateful threshold events are:

    • persistent. The events remain active until specific clear-threshold conditions are met at the end of a subsequent interval.

    • enacted when the clear-threshold is set within the configured range. A value of zero indicates the event clears if no results fall within the specified range in a subsequent interval.

Delay event
Delay events are counter-based events. These are simple counts that compare to the raise-threshold for raising and the clear-threshold for clearing. These are for each direction, forward, backward, and round-trip. Each of these delay thresholds are raised a maximum of one in a measurement interval when the count in the specified bin or bins reach the raise-threshold. The types of delay events are as follows:
  • Frame Delay (FD)

  • Frame Delay Range (FDR)

  • Inter-Frame Delay Variation (IFDV)

Each of these delay threshold events are raised a single time in a measurement interval immediately after the threshold is reached.

Loss events

The types of loss events are as follows:

  • counter-based events. These are simple counts that compare to the raise-threshold for raising and the clear-threshold for clearing. The standard directions, forward and backward as well as a mathematical aggregate that is computed by summing the forward and backward values, are supported. Each of these loss threshold events are raised a maximum of one time in a measurement interval when the count in the specified bin or bins reach the raise-threshold.

    • High Loss Interval (HLI) event

    • Consecutive High Loss Interval (CHLI) event

    • unavailability event

    • undetermined availability event

    • undetermined unavailability event

  • Average Frame Loss Ratio (Avg-FLR) event. Unlike other loss events, the Avg-FLR event is raised only at the end of the measurement interval. This event does not support aggregated computation. It supports forward and backward directions.

Loss event template

The loss event template is created using the oam performance-monitoring ip loss loss-events-template command. All of the loss events are configured using this template. During loss measurement, the loss event template is referenced by a performance monitoring session.

The following considerations apply to loss event templates:

  • A loss event template cannot be deleted if it is referenced by a performance monitoring session.

  • A loss event template can be modified even if it is referenced by a performance monitoring session without disrupting the ongoing session.

  • The reference changes that include, adding a new reference or deleting an existing reference within a loss test session can be done without impacting the performance monitoring session or the loss test session.

  • The configuration changes made to loss event templates affect only the loss event function ensuring that performance monitoring continues seamlessly.

  • The operational states of the loss events transition based on the configuration changes and the timing of measurement intervals.

Bin group

A bin group is a collection of bins where each bin represents a range of delay values. When a delay measurement is performed, the delay results are stored in appropriate bins based on its value. This process is known as binning and it allows for a structured and aggregated view of delay performance over time. Bin groups are created using the oam performance-monitoring ip delay bin-group command and referenced by the session using the oam performance-monitoring ip session stamp delay bin-group command.

Bin type

There are three types of binnable delay metrics:

  • frame delay (FD)

  • inter-frame delay variation (IFDV)

  • frame delay range (FDR)

All bin types are available in the forward, backward, and round-trip directions. Each of these metrics can have up to ten bin groups configured to group the results.

Bin boundary

Bin groups are configured by indicating a lower boundary. Bin 0 has a lower boundary that is always zero and is not configurable. The microsecond range of the bins is the difference between the adjacent lower boundaries.

For example, bin-type fd bin 1 configured with lower-bound 1000 means that:
  • bin 0 captures all frame delay statistics results between 0 and 1 ms

  • bin 1 captures all results above 1 ms and below the bin 2 lower boundary. Bin 2 is not shown.

The last bin configured represents the bin that collects all the results at and above that lower-bound value. Not all ten bins have to be configured.

Each delay type requires their own values for the bin groups. It is not possible to configure a bin with different values for round trip, forward, and backward. Consider the configuration of the boundaries that represent the important statistics for that specific requirement.

Bin group 1 is the default bin group. Every session requires a bin group to be assigned. By default, bin group 1 is assigned to every performance monitoring session that does not have a bin group explicitly configured. Bin group 1 cannot be modified. Bin group 1 is an automatically created object and not visible in the configuration. If the bin-group 1 is added to the configuration only the mandatory default configuration values may be added. If bin-group 1 is added to the configuration it behaves as non-default bin-groups.

Bin group behaviour
The following considerations apply for bin groups:
  • Bin groups cannot be deleted if referenced by a performance monitoring session.

  • Bin groups cannot be disabled if referenced by a delay test with the admin-state parameter set to enable.

  • Bin groups can be modified even if referenced by a delay test regardless of the admin-state parameter setting. Delay results for the performance monitoring session referencing a changed bin-group is deleted and a new set of bins start recording results.
  • Bin group that is excluded from average can be modified even if referenced by a delay test with the admin-state parameter set to enable.

  • Any changes to the attributes of the oam performance-monitoring ip delay bin-group bin-type delay-event command do not affect the performance monitoring session or test sessions.

Configuring STAMP OAM performance monitoring session

To configure a STAMP OAM performance monitoring session, use the oam performance-monitoring ip session command and configure the parameters as shown in Configuring a STAMP OAM performance monitoring session.

To allocate a source UDP port to the OAM STAMP application, use the oam ippm source-udp-port-pools port 64374 application-assignment oam-pm-ip command and configure the parameters as shown in Allocating source UDP port to OAM performance monitoring application. Configuration of the source UDP port should only be used when explicitly required. If not configured, the source UDP port is dynamically allocated from the dynamic UDP port range by the OAM performance monitoring application.

Configuring a STAMP OAM performance monitoring session

This example configures a STAMP OAM performance monitoring session.

--{ + candidate shared default }--[  ]--
# info oam performance-monitoring ip session ip-sess-1
    oam {
        performance-monitoring {
            ip {
                session ip-sess-1 {
                    session-type proactive
                    destination-ip 192.168.1.2
                    destination-udp-port 862
                    source-ip 192.168.1.1
                    network-instance net-inst-default
                    dscp EF
                    profile in
                    measurement-interval 1-minute {
                        boundary-type clock-aligned
                        clock-offset 0
                        intervals-stored 32
                        threshold-alerts {
                            loss-event enable
                            delay-event enable
                        }
                    }
                    stamp {
                        admin-state enable
                        test-id auto
                        interval 100ms
                        delay {
                            bin-group 2
                        }
                        loss {
                            flr-threshold 5
                            hli-force-count true
                            loss-event loss-1
                            timing {
                                frames-per-delta-t 10
                                consecutive-delta-t 10
                                chli-threshold 5
                            }
                        }
                    }
                }
            }
        }
    }
Allocating source UDP port to OAM performance monitoring application

This example allocates a source UDP port to the OAM performance monitoring application.

--{ + candidate shared default }--[  ]--
A:srl1# info oam ippm source-udp-port-pools
    oam {
        ippm {
            source-udp-port-pools {
                port 64374 {
                    application-assignment oam-pm-ip
                }
            }
        }
    }

Performing delay measurement

Perform the following steps to measure packet delay as part of STAMP OAM performance monitoring:

  1. Configure a bin group. Use the oam performance-monitoring ip delay bin-group command and specify the parameters as shown in the following example.
    Configuring a bin group
    --{ + candidate shared default }--[  ]--
    # info oam performance-monitoring ip delay bin-group gp2
        oam {
            performance-monitoring {
                ip {
                    delay {
                        bin-group gp2 {
                            admin-state enable
                        }
                    }
                }
            }
        }
  2. Configure the bin type and delay measurement parameters. Use the oam performance-monitoring ip delay bin-group bin-type command and specify the bin-type and delay-event parameters.
    Configuring a bin type
    --{ + candidate shared default }--[  ]--
    # info oam performance-monitoring ip delay bin-group 2 bin-type fd
        oam {
            performance-monitoring {
                ip {
                    delay {
                        bin-group 2 {
                            bin-type fd {
                                bin 0 {
                                    lower-bound 0
                                }
                                bin 1 {
                                    lower-bound 500
                                }
                                bin 2 {
                                    lower-bound 1000
                                }
                                bin 3 {
                                    lower-bound 1500
                                }
                                bin 4 {
                                    lower-bound 2000
                                }
                                bin 5 {
                                    lower-bound 2500
                                }
                                bin 6 {
                                    lower-bound 3000
                                }
                                bin 7 {
                                    lower-bound 3500
                                }
                                bin 8 {
                                    lower-bound 4000
                                }
                                bin 9 {
                                    lower-bound 4500
                                }
                                delay-event round-trip {
                                    lowest-bin 8
                                    raise-threshold 10
                                    clear-threshold 0
                                    exclude-lowest-bin 9
                                }
                            }
                        }
                    }
                }
            }
        }
  3. Configure the session type. Perform one of the following:
    1. To configure a proactive test session, use the oam performance-monitoring ip session session-type proactive command.
      Configuring a proactive test session
      --{ + candidate shared default }--[  ]--
      # info oam performance-monitoring ip session ip-sess-1 session-type
          oam {
              performance-monitoring {
                  ip {
                      session ip-sess-1 {
                          session-type proactive
                      }
                  }
              }
          }
    2. To configure an on-demand test session, use the oam performance-monitoring ip session session-type on-demand command.
      Configuring an on-demand test session
      --{ +* candidate shared default }--[  ]--
      # info oam performance-monitoring ip session ip-sess-1 session-type
          oam {
              performance-monitoring {
                  ip {
                      session ip-sess-1 {
                          session-type on-demand
                      }
                  }
              }
          }
  4. Enable STAMP and associate the bin group that has the delay measurement parameters configured. Use the info oam performance-monitoring ip session stamp command and specify the STAMP parameters and associate the bin group.
    Configuring STAMP parameters for delay measurement
    --{ +* candidate shared default }--[  ]--
    # info oam performance-monitoring ip session ip-sess-1 stamp
        oam {
            performance-monitoring {
                ip {
                    session ip-sess-1 {
                        stamp {
                            admin-state enable
                            test-id auto
                            test-duration 60
                            interval 100ms
                            delay {
                                bin-group 2
                            }
                        }
                    }
                }
            }
        }
  5. Start delay measurement. Perform one of the following:
    1. When you set the oam performance-monitoring ip session stamp admin-state command to enable, the proactive test starts immediately.
    2. To start an on-demand session, use the tools oam performance-monitoring ip session on-demand-action start command.
      The on-demand session starts.
      --{ + candidate shared default }--[  ]--
      # tools oam performance-monitoring ip session ip-sess-1 on-demand-action start
      /oam/performance-monitoring/ip/session[session-name=ip-sess-1]:
          OnDemand session started successfully
  6. Stop delay measurement. Perform one of the following:
    1. When you set the oam performance-monitoring ip session stamp admin-state command to disable, the proactive test stops immediately.
    2. To stop an on-demand session, use the tools oam performance-monitoring ip session on-demand-action stop command.
      The on-demand session stops.
      --{ + candidate shared default }--[  ]--
      # tools oam performance-monitoring ip session ip-sess-1 on-demand-action stop
      /oam/performance-monitoring/ip/session[session-name=ip-sess-1]:
          OnDemand session stopped successfully
    3. You can use the oam performance-monitoring ip session stamp test-duration command to determine the duration of the test and the test stops after the completion of the configured time duration.
      Configure time duration for on-demand test
      --{ +* candidate shared default }--[  ]--
      # info oam performance-monitoring ip session ip-sess-1 stamp test-duration
          oam {
              performance-monitoring {
                  ip {
                      session ip-sess-1 {
                          stamp {
                              test-duration 60
                          }
                      }
                  }
              }
          }

Performing loss measurement

Perform the following steps to measure packet loss as part of STAMP OAM performance monitoring:

  1. Configure a loss events template. Use the oam performance-monitoring ip loss loss-events-template command and specify the loss event parameters as shown in the following example.
    Configuring a loss events template
    --{ +* candidate shared default }--[  ]--
    # info oam performance-monitoring ip loss loss-events-template loss-1
        oam {
            performance-monitoring {
                ip {
                    loss {
                        loss-events-template loss-1 {
                            hli-event aggregate {
                                raise-threshold 12
                                clear-threshold 6
                            }
                        }
                    }
                }
            }
        }
  2. Configure the session type. Perform one of the following:
    1. To configure a proactive test session, use the oam performance-monitoring ip session session-type proactive command.
      Configuring a proactive test session
      --{ + candidate shared default }--[  ]--
      # info oam performance-monitoring ip session ip-sess-1 session-type
          oam {
              performance-monitoring {
                  ip {
                      session ip-sess-1 {
                          session-type proactive
                      }
                  }
              }
          }
    2. To configure an on-demand test session, use the oam performance-monitoring ip session session-type on-demand command.
      Configuring an on-demand test session
      --{ +* candidate shared default }--[  ]--
      # info oam performance-monitoring ip session ip-sess-1 session-type
          oam {
              performance-monitoring {
                  ip {
                      session ip-sess-1 {
                          session-type on-demand
                      }
                  }
              }
          }
  3. Enable STAMP and associate the loss events template that has the loss measurement parameters configured. Use the oam performance-monitoring ip session stamp command and specify the parameters as shown in the following example.
    Configuring STAMP parameters for loss measurement
    --{ +* candidate shared default }--[  ]--
    # info oam performance-monitoring ip session ip-sess-1 stamp
        oam {
            performance-monitoring {
                ip {
                    session ip-sess-1 {
                        stamp {
                            admin-state enable
                            test-id auto
                            test-duration 60
                            interval 100ms
                            delay {
                                bin-group 2
                            }
                            loss {
                                flr-threshold 5
                                hli-force-count true
                                loss-event loss-1
                                timing {
                                    frames-per-delta-t 10
                                    consecutive-delta-t 10
                                    chli-threshold 5
                                }
                            }
                        }
                    }
                }
            }
        }
  4. Start loss measurement. Perform one of the following:
    1. When you set the oam performance-monitoring ip session stamp admin-state command to enable, the proactive test starts immediately.
    2. To start an on-demand session, use the tools oam performance-monitoring ip session on-demand-action start command.
      The on-demand session starts.
      --{ + candidate shared default }--[  ]--
      # tools oam performance-monitoring ip session session1 on-demand-action start
      /oam/performance-monitoring/ip/session[session-name=session1]:
          OnDemand session started successfully
      
  5. Stop delay measurement. Perform one of the following:
    1. When you set the oam performance-monitoring ip session stamp admin-state command to disable, the proactive test stops immediately.
    2. To stop an on-demand session, use the tools oam performance-monitoring ip session on-demand-action stop command.
      The on-demand session stops.
      --{ + candidate shared default }--[  ]--
      # tools oam performance-monitoring ip session session1 on-demand-action stop
      /oam/performance-monitoring/ip/session[session-name=session1]:
          OnDemand session stopped successfully
      
    3. You can use the oam performance-monitoring ip session stamp test-duration command to determine the duration of the test and the test stops after the completion of the configured time duration.
      Configure time duration for on-demand test
      --{ +* candidate shared default }--[  ]--
      # info oam performance-monitoring ip session session1 stamp test-duration
          oam {
              performance-monitoring {
                  ip {
                      session session1 {
                          stamp {
                              test-duration 60
                          }
                      }
                  }
              }
          }

Displaying delay and loss measurement results

To display the results of delay and loss measurement, use the info from state oam performance-monitoring ip session command.

Displaying the results of delay and loss measurement

This example displays the delay and loss measurement results.

--{ + candidate shared default }--[ oam performance-monitoring ip ]--
# info from state
        session-type proactive
        destination-ip 192.168.1.2
        destination-udp-port 862
        source-ip 192.168.1.1
        source-udp-port 44000
        network-instance net-inst-default
        dscp EF
        profile in
        ttl 255
        measurement-interval 1-minute {
            boundary-type clock-aligned
            clock-offset 0
            intervals-stored 32
            threshold-alerts {
                loss-event enable
                delay-event enable
            }
        }
        stamp {
            admin-state enable
            oper-state up
            detected-tx-error none
            test-id auto
            test-id-in-use 2147483650
            test-duration 0
            pad-tlv-size 0
            interval 100ms
            statistics {
                stamp-unrecognized-flag-received 0
                stamp-malformed-flag-received 0
            }
            delay {
                bin-group 2
                bin-group-binning active
                measurement-result 1-minute {
                    newest-index 2
                    index 1 {
                        oper-state in-progress
                        suspect-status true
                        start-time 2024-07-05T19:11:54.000Z
                        elapsed-time 6
                        statistics {
                            frames-transmitted 55
                            frames-received 55
                            bin-type fd {
                                forward {
                                    minimum 145
                                    maximum 303
                                    average 208
                                }
                                backward {
                                    minimum 115
                                    maximum 241
                                    average 170
                                }
                                round-trip {
                                    minimum 290
                                    maximum 499
                                    average 379
                                }
                                bin 0 {
                                    forward-measurements 55
                                    backward-measurements 55
                                    round-trip-measurements 55
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type fdr {
                                forward {
                                    minimum 0
                                    maximum 157
                                    average 51
                                }
                                backward {
                                    minimum 0
                                    maximum 121
                                    average 43
                                }
                                round-trip {
                                    minimum 0
                                    maximum 181
                                    average 68
                                }
                                bin 0 {
                                    forward-measurements 55
                                    backward-measurements 55
                                    round-trip-measurements 55
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type ifdv {
                                forward {
                                    minimum 0
                                    maximum 158
                                    average 43
                                }
                                backward {
                                    minimum 0
                                    maximum 95
                                    average 27
                                }
                                round-trip {
                                    minimum 4
                                    maximum 130
                                    average 54
                                }
                                bin 0 {
                                    forward-measurements 50
                                    backward-measurements 54
                                    round-trip-measurements 44
                                }
                                bin 1 {
                                    forward-measurements 4
                                    backward-measurements 0
                                    round-trip-measurements 10
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                        }
                    }
                    index 2 {
                        oper-state in-progress
                        suspect-status false
                        start-time 2024-07-05T19:12:00.000Z
                        elapsed-time 3
                        statistics {
                            frames-transmitted 32
                            frames-received 32
                            bin-type fd {
                                forward {
                                    minimum 158
                                    maximum 268
                                    average 219
                                }
                                backward {
                                    minimum 98
                                    maximum 281
                                    average 172
                                }
                                round-trip {
                                    minimum 294
                                    maximum 512
                                    average 391
                                }
                                bin 0 {
                                    forward-measurements 32
                                    backward-measurements 32
                                    round-trip-measurements 30
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 2
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type fdr {
                                forward {
                                    minimum 13
                                    maximum 123
                                    average 74
                                }
                                backward {
                                    minimum 0
                                    maximum 183
                                    average 72
                                }
                                round-trip {
                                    minimum 4
                                    maximum 222
                                    average 101
                                }
                                bin 0 {
                                    forward-measurements 32
                                    backward-measurements 32
                                    round-trip-measurements 32
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type ifdv {
                                forward {
                                    minimum 1
                                    maximum 97
                                    average 24
                                }
                                backward {
                                    minimum 0
                                    maximum 109
                                    average 51
                                }
                                round-trip {
                                    minimum 4
                                    maximum 174
                                    average 62
                                }
                                bin 0 {
                                    forward-measurements 32
                                    backward-measurements 29
                                    round-trip-measurements 28
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 3
                                    round-trip-measurements 4
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                        }
                    }
                }
                measurement-result raw {
                    newest-index 1
                    index 1 {
                        oper-state in-progress
                        suspect-status true
                        start-time 2024-07-05T19:11:54.000Z
                        elapsed-time 9
                        statistics {
                            frames-transmitted 87
                            frames-received 87
                            bin-type fd {
                                forward {
                                    minimum 145
                                    maximum 303
                                    average 212
                                }
                                backward {
                                    minimum 98
                                    maximum 281
                                    average 171
                                }
                                round-trip {
                                    minimum 290
                                    maximum 512
                                    average 383
                                }
                                bin 0 {
                                    forward-measurements 87
                                    backward-measurements 87
                                    round-trip-measurements 85
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 2
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type fdr {
                                forward {
                                    minimum 0
                                    maximum 157
                                    average 60
                                }
                                backward {
                                    minimum 0
                                    maximum 183
                                    average 53
                                }
                                round-trip {
                                    minimum 0
                                    maximum 222
                                    average 80
                                }
                                bin 0 {
                                    forward-measurements 87
                                    backward-measurements 87
                                    round-trip-measurements 87
                                }
                                bin 1 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                            bin-type ifdv {
                                forward {
                                    minimum 0
                                    maximum 158
                                    average 36
                                }
                                backward {
                                    minimum 0
                                    maximum 109
                                    average 36
                                }
                                round-trip {
                                    minimum 4
                                    maximum 174
                                    average 57
                                }
                                bin 0 {
                                    forward-measurements 82
                                    backward-measurements 83
                                    round-trip-measurements 72
                                }
                                bin 1 {
                                    forward-measurements 4
                                    backward-measurements 3
                                    round-trip-measurements 14
                                }
                                bin 2 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 3 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 4 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 5 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 6 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 7 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 8 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                                bin 9 {
                                    forward-measurements 0
                                    backward-measurements 0
                                    round-trip-measurements 0
                                }
                            }
                        }
                    }
                }
                delay-events fd direction round-trip {
                    last-tca-time 1970-01-01T00:00:00.000Z
                    oper-state not-active
                }
                delay-events ifdv direction round-trip {
                    last-tca-time 1970-01-01T00:00:00.000Z
                    oper-state not-active
                }
            }
            loss {
                flr-threshold 5
                hli-force-count true
                loss-event loss-1
                timing {
                    frames-per-delta-t 10
                    consecutive-delta-t 10
                    chli-threshold 5
                }
                measurement-result 1-minute {
                    newest-index 2
                    index 1 {
                        oper-state in-progress
                        suspect-status true
                        start-time 2024-07-05T19:11:54.000Z
                        elapsed-time 6
                        statistics {
                            frames-transmitted 55
                            frames-received 55
                            forward {
                                out-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                            backward {
                                in-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                        }
                    }
                    index 2 {
                        oper-state in-progress
                        suspect-status false
                        start-time 2024-07-05T19:12:00.000Z
                        elapsed-time 3
                        statistics {
                            frames-transmitted 32
                            frames-received 32
                            forward {
                                out-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                            backward {
                                in-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                        }
                    }
                }
                measurement-result raw {
                    newest-index 1
                    index 1 {
                        oper-state in-progress
                        suspect-status true
                        start-time 2024-07-05T19:11:54.000Z
                        elapsed-time 9
                        statistics {
                            frames-transmitted 87
                            frames-received 87
                            forward {
                                out-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                            backward {
                                in-loss 0
                                available 0
                                unavailable 0
                                undetermined-available 0
                                undetermined-unavailable 0
                                high-loss-intervals 0
                                consecutive-high-loss-intervals 0
                                minimum-frame-loss-ratio 0
                                maximum-frame-loss-ratio 0
                                average-frame-loss-ratio 0
                            }
                        }
                    }
                }
                loss-events hli direction aggregate {
                    last-tca-time 1970-01-01T00:00:00.000Z
                    oper-state not-active
                }
            }
        }
    }