RCR Wireless
  • News
  • Channels
    • 5G
    • 6G
    • BSS OSS
    • Carriers
    • IoT
    • Network Infrastructure
    • Open RAN
    • Private 5G
    • Telco AI
    • Telco Cloud
    • Test & Measurement
  • Resources
    • Reports
    • Webinars
    • White papers
    • AI Fundamentals
    • Analyst Angle
    • Editorial Calendar
    • Fundamentals
      • 5G NR Release 17
      • AI
        • Telco AI in 2025
    • Podcasts
      • Let’s Get Digital with Carrie Charles
      • Wireless Connectivity to Enable Industry 4.0 for the Middleprise
      • Well Technically…
      • Will 5G Change the World
      • Accelerating Industry 4.0 Digitalization
  • AI Infrastructure
  • Programs
  • Events
  • RCRtv
  • Advertise
  • Subscribe
Saturday, August 29, 2026
RCR Wireless
  • News
  • Channels
    • 5G
    • 6G
    • BSS OSS
    • Carriers
    • IoT
    • Network Infrastructure
    • Open RAN
    • Private 5G
    • Telco AI
    • Telco Cloud
    • Test & Measurement
  • Resources
    • Reports
    • Webinars
    • White papers
    • AI Fundamentals
    • Analyst Angle
    • Editorial Calendar
    • Fundamentals
      • 5G NR Release 17
      • AI
        • Telco AI in 2025
    • Podcasts
      • Let’s Get Digital with Carrie Charles
      • Wireless Connectivity to Enable Industry 4.0 for the Middleprise
      • Well Technically…
      • Will 5G Change the World
      • Accelerating Industry 4.0 Digitalization
  • AI Infrastructure
  • Programs
  • Events
  • RCRtv
  • Advertise
  • Subscribe
Add RCR Wireless as a preferred source on Google
  • Qualcomm 6G Insights
  • Huawei Content Hub
  • Qualcomm – 6G Vision
  • OSS/BSS Channel
  • RCRTech Roundtable: AI Infrastructure
RCR Wireless
RCR Wireless
  • Advanced Mimo
  • Mobile mmWave
  • 5G Positioning
  • Green Networks
  • Metaverse
  • Automotive
  • Industrial and Wide-area IoT
Copyright 2021 - All Right Reserved
Home - Reader Forum: The challenges of PCAP and ‘big data’
OpinionReader Forum

Reader Forum: The challenges of PCAP and ‘big data’

by Kelly Hill October 27, 2014
written by Kelly Hill October 27, 2014 Share
LinkedinEmail
Share 0LinkedinEmail
PCAP and big data
James Goodwin of Anite on PCAP and big data
157

Editor’s Note: In an attempt to broaden our interaction with our readers we have created this Reader Forum for those with something meaningful to say to the wireless industry. We want to keep this as open as possible, but we maintain some editorial control to keep it free of commercials or attacks. Please send along submissions for this section to our editors at: [email protected].

Packet capture file format for packet capture is the preferred medium used throughout the industry for debugging, replication, simulation, sampling, testing and analysis where a network trace is required. It conveniently facilitates offline usage, allowing engineers to meticulously navigate through a network trace in their own time categorically defining hidden handover messages, hosts, sources, destinations, interacting nodes and protocols – all in plain text. Communications service providers, cyber-security firms and system integrators use the Libpcap library for packet sniffing, monitoring, stress-testing, equipment hardening/robustness testing and intrusion detection.

For its host of practical use cases PCAP weighs heavily on the minds of manufacturers as well. It provides the “best” network model accessible, where it is not possible to directly connect to the live network 100% of the time. This means engineers can rigorously test their products prior to live network integration with a degree of confidence.

The criteria for a “good” PCAP is based on completeness, interfaces traced, decoded IEs and speed at which it can run. The typical method of obtaining a PCAP is to trace the network interface(s) in question for a definable period of time until the user is confident an adequate representation of the network traffic has been captured.

However, following the introduction of “10 gigabits per second” and the “big data” phenomena, PCAP traces today are bloated, complex and in some instances unreadable. For example, Wireshark – the de-facto third-party open source tool for PCAP interpretation – can only process a file of up to two gigabytes in size, and although it boasts an impressive 200 protocol decode library, it would struggle to function if it had to process a 10 Gbps sample. Realistically, it can process at 100 megabits per second. This means the seamless trace of 5 GB from the 10 Gbps interface cannot be processed by the industry’s most comprehensive tool.

As networks now run at multiples of 10 Gbps composed of voice over IP/voice over LTE, video, call control, messaging and traditional telephony you may require:

  • A “bulk” capture containing every protocol.
  • A “filtered” capture containing only protocols of interest.
  • A “subscriber” capture containing only the sessions associated with specific subscriber(s).

The current method in effect is to take a complete or bulk sample and attach an analysis suite to decipher, extract and reconstruct a PCAP with relevant packets. This technique invokes an abundance of logic and complex algorithms to ensure zero packet loss, correlation, accurate time stamping and intact synchronisation. This, in actuality, cannot be guaranteed, not to mention the lost time it takes to analyse a whole 5 GB, 10 Gbps PCAP file.

The alternative is to intelligently and passively process packets; pre-filtering and extracting only packets of interest in real-time. Implementing a hybrid hardware/software product utilizing de-tunnelling and DPI to ensure a refined PCAP compatible with industry-standard third-party tools and full end-to-end correlation enables the user to conduct their role efficiently.

The reduced capital/operating expense, floor space, complexity of application needed and size/data rate means that enabling equipment like this is efficient, cost-effective and portable, allowing it to be used to capture PCAPs remotely or onsite in conjunction with a tap point.

James Goodwin joined Anite in 2000 as project manager of the GPRS conformance product line. After managing the development of many Anite products through the technology progression from 2G to 3G, he joined the company’s product management team in 2007. He is now director of product management, responsible for the portfolio management of Anite’s Handset Testing products. Goodwin is a chartered engineer and holds a Ph.D. and MEng in Electrical and Electronic Engineering.

You Might Also Like
  • How space traffic management can save our satellites (Reader Forum)
  • Thursday (telco diary) | Ghosts in the machine – Wanted: more humans to build AI
  • Wednesday (telco diary) | Smells like team spirit – and that tech-bro Musk
  • Tuesday (telco diary) | About open RAN, c/o Dell’Oro…
  • Europe’s AI ambitions will fail without sovereign cloud infrastructure (Reader Forum)
  • Monday (telco diary) | Digging in, moving up – lessons from Lumen
Share 0 LinkedinEmail
Kelly Hill

Kelly Hill reports on network test and measurement, AI infrastructure and regulatory issues, including spectrum, for RCR Wireless News. She began covering the wireless industry in 2005, focusing on carriers and MVNOs, then took a few years’ hiatus and returned to RCR Wireless News to write about heterogeneous networks (remember those?) and network infrastructure. Kelly is an Ohio native with a masters degree in journalism from the University of California, Berkeley, where she focused on science writing and multimedia. She has written for the San Francisco Chronicle, The Oregonian and The Canton Repository. She lives in northern Virginia, not far from Data Center Alley.

previous post
EMEA: Nokia Networks sees rising demand for VoLTE outside U.S.
next post
Reader Forum: Device dependence and the evolution of smartphone trade-ins

White Papers

  • Norton eBook: The 2026 Telco Playbook

  • Enea White Paper: Why Intelligent AAA is the Swiss Army Knife of Telecom

  • CSG White Paper: Telco AI Enabler: Mediation’s Defining Role

  • Enea White Paper: Scalable Database Design for 5G and Beyond

  • Supermicro and NVIDIA Whitepaper: Powering sovereign AI at scale

Editorial Reports

  • Report: Rethinking the RAN

  • Report: Building AI-Era Network Fabrics

  • Quantum Safe Networks Market Pulse Report

Webinars

  • Mimosa Webinar – Build the Right Network

  • Webinar: Building 6G — aligning technology, policy and purpose

  • SIMCom Webinar: Scaling your next deployment – from plastic to provisioning

  • Webinar: Rethinking the RAN as AI, cloud and openness converge

  • Webinar: Scale-Up, Scale-Out, Scale-Across – Building AI-Era Network Fabrics

Since 1982, RCR Wireless News has been providing wireless and mobile industry news, insights, and analysis to mobile and wireless industry professionals, decision makers, policy makers, analysts and investors.

Facebook Twitter Youtube Linkedin Envelope Rss

Useful Links

  • Subscribe
  • About RCR Wireless News
  • Contact Us
  • Advertise
  • Editorial Calendar
  • Archive
  • RSS
  • Wireless News Archive
  • Subscribe
  • About RCR Wireless News
  • Contact Us
  • Advertise
  • Editorial Calendar
  • Archive
  • RSS
  • Wireless News Archive

Edtior's Picks

AT&T takes OTel 2.0 into production
Report: Rethinking the RAN
How space traffic management can save our satellites (Reader Forum)

Latest Articles

AT&T takes OTel 2.0 into production
Report: Rethinking the RAN
How space traffic management can save our satellites (Reader Forum)
Verizon and Google Cloud expand AI partnership across service, network, and data

© 2026 RCR Wireless News All Right Reserved. Developed by Eight Hats.

Cookie Policy | Privacy Policy

RCR Wireless
  • News
  • Channels
    • 5G
    • 6G
    • BSS OSS
    • Carriers
    • IoT
    • Network Infrastructure
    • Open RAN
    • Private 5G
    • Telco AI
    • Telco Cloud
    • Test & Measurement
  • Resources
    • Reports
    • Webinars
    • White papers
    • AI Fundamentals
    • Analyst Angle
    • Editorial Calendar
    • Fundamentals
      • 5G NR Release 17
      • AI
        • Telco AI in 2025
    • Podcasts
      • Let’s Get Digital with Carrie Charles
      • Wireless Connectivity to Enable Industry 4.0 for the Middleprise
      • Well Technically…
      • Will 5G Change the World
      • Accelerating Industry 4.0 Digitalization
  • AI Infrastructure
  • Programs
  • Events
  • RCRtv
  • Advertise
  • Subscribe
RCR Wireless
  • News
  • Channels
    • 5G
    • 6G
    • BSS OSS
    • Carriers
    • IoT
    • Network Infrastructure
    • Open RAN
    • Private 5G
    • Telco AI
    • Telco Cloud
    • Test & Measurement
  • Resources
    • Reports
    • Webinars
    • White papers
    • AI Fundamentals
    • Analyst Angle
    • Editorial Calendar
    • Fundamentals
      • 5G NR Release 17
      • AI
        • Telco AI in 2025
    • Podcasts
      • Let’s Get Digital with Carrie Charles
      • Wireless Connectivity to Enable Industry 4.0 for the Middleprise
      • Well Technically…
      • Will 5G Change the World
      • Accelerating Industry 4.0 Digitalization
  • AI Infrastructure
  • Programs
  • Events
  • RCRtv
  • Advertise
  • Subscribe
@2020 - All Right Reserved. Designed and Developed by PenciDesign