A Multithreaded Message Passing Environment for ATM LAN/WAN Salim Hariri ECE Department Syracuse University Presentation Outline % Overview of Message Passing Tools % Overview of NCS Design Approach % NCS Implementation Approach % Conclusion Remarks Need for a New Communication System - I Need for a New Communication System - II Need for a new Communication Systyem - III P4 overview p4 initialization Communication in p4 PVM overview PVM daemons (pvmd) Communication in PVM Communication Functions p4 vs PVM p4 vs PVM: Performance results Problems with Existing Systems Related Efforts Drawbacks Objectives of NYNET Communication Systems NCS Design Approach 1 % Simplicity Simplify the network architecture by removing unnecessary network layer and replicated functions in transport and data link layer ! Low latency protocols that can operate at Gigabit transfer rates NCS Design Approach 1 NCS Design Approach 2 % Concurrent Data Transfers ! Multiple, concurrent data transfer increases the utilization of the network resources and effective bandwidth. ! parallel protocol processing, parallel data transfer between Host-NI and NI-Host. NCS Design Approach 2 -- Contd NCS Design Approach 3 % Bypass operating system to reduce number of data copying operations. Have kernel buffers mapped to user address space. NCS Design Approach 3 -- Contd NCS Design Approach 4 % Provide services for overlapping communication with computation. Have multiple threads per process. NCS Design Approach 4 -- Contd NCS Design Approach 5 % Modular Approach - support wide range of HPCC QOS requirements. Multithread approach is flexible. NCS Design approach 5 -- Contd NYNET Communication System Higher Level Environment for NCS Generic model for an application NCS Primitives NCS Implementation Approach NCS_MTS Implementation NCS_MTS Implementation Contd Approach 1: Using P4 NCS using P4 -- Approach 1 Approch 2: Using ATM API NCS Using ATM API -- approach 2 NCS Benchmarking and Evaluation Matrix Multiplication NYNET Applications JPEG Compression/Decompression JPEG Compression/Decompression Contd NYNET Applications -- JPEG Simulation Other NYNET Applications -- Video on Demand Collaboratory and Telemedicine on NYNET Drawbacks of ATM API Drawbacks of ATM API (cont.) Solutions Read/Write Traps Trap Interface Results Receive Mechanism in Fore device driver Receive mechanism with Trap Routine Problems experienced in implementing receive trap routines read trap handler recv trap interface recv Rountine Architecture NCS Process Communication architecture Thread based Programming paradigm NCS has two levels of threads Separate Control and Data daemons Control Daemons Multiple Flow Control Hierarchical Receive Queue Structure Hierarchical Receive Queue Structure Multicast: Existing schemes Multicast: NCS approach Advantages Observations Summary % Completed NCS implementation using P4. % Benchmark/evaluation of NCS/P4 implementation. % Completed NCS implementation using PVM. % Work in progress evaluating NCS/PVM. % NCS/API implementation. # Send/Recv (complete). # Multicast, flow control (work in progress).