• Skip to Main Content
  • Go to the Website's Home
  • Go to Website News
  • Go to About this site
  • Skip to Audience Navigation Menu
  • About
    • Welcome to the College
    • Facts and Figures
    • Message from the Dean
    • Visit Us
    • College Administration
    • News Center
  • Research
    • Research Home
    • Departments
    • Centers & Labs
    • Faculty Directory
    • Opportunities for Undergraduates
  • Admissions
    • Undergraduate Admissions
    • Undergraduate Recruiting
    • Graduate Admissions
  • Academics
    • Departments
    • Undergraduate Programs and Degrees
    • Graduate Programs and Degrees
    • Course Guide/Bulletin
    • Teaching
    • Support Services
  • Departments
    • Aerospace Engineering
    • Atmospheric, Oceanic and Space Sciences
    • Biomedical Engineering
    • Chemical Engineering
    • Civil and Environmental Engineering
    • Electrical Engineering and Computer Science
    • Industrial and Operations Engineering
    • Interdisciplinary Professional Programs
    • Materials Science and Engineering
    • Mechanical Engineering
    • Naval Architecture and Marine Engineering
    • Nuclear Engineering and Radiological Sciences
  • Support the College
    • Giving
    • Involve Yourself
    • Corporate Relationships
  •   

College of Engineering

Center for Advanced Computing

  • Welcome
  • About
  • Getting Started
    • Getting Started
    • Learning About HPC
    • CAC Training Courses
  • Resources
    • Resources
    • Systems
    • Software
    • Storage
    • Networking
    • Visualization
    • Teragrid
  • Academics
  • Contact Us
  • Frequently Asked Questions
Follow Us On Twitter

Contact Information

[Contact] Center for Advanced Computing
College of Engineering
cac-support@umich.edu Link

Center for Advanced Computing  /  Resources  /  Networking  /  Infiniband FAQ

  • Networking
  • Infiniband
  • Infiniband FAQ

Infiniband FAQ

Q: What is Infiniband?
A: Infiniband is a high bandwidth low latency network commonly found on clusters.
Q: How fast is Infiniband? What is its latency?
A: Infiniband is a 10Gbps network, all Infiniband at the CAC is nonblocking (no single connection is ever starved of the entire 10Gbps link. The latency of Infiniband is about one order of magnitude less than Ethernet. This puts Infiniband at less than 10 usec latency, since many codes are very sensitive to latency, this can offer a large performance gain.
Q: Do I need to recompile my code to use Infiniband?
A: If you compiled your code with our default MPI library on nyx, you do not need to recompile.
Q: How do I compile my code to use Infiniband?
A: Compile your code using our standard MPI compilers (mpicc, mpif90, etc.)
Q: I compiled my code for Infiniband can I run it on TCP (Ethernet) only nodes?
A: Yes! This is the benefit of the MPI library that we provide. Code compiled for Infiniband will also have the ability to run on Ethernet without recompiling. If mpirun finds that some of the nodes given to you do not have Infiniband then those nodes will use Ethernet. The nodes with Infiniband will use Infiniband.
Q: What advantages does Infiniband give me?
A: Infiniband allows bandwidth and latency sensitive codes to scale farther. For a example a code that scales to 12 cpus on Ethernet might get to 24 on Infiniband. If a code does not communicate often (like Monti Carlo codes) Infiniband will not improve your code's performance.
CSS 2.1 Valid
University of Michigan
  • Home
  • Contact Us
  • Site Map
  • Site Feedback
  • Accessibility
  • Emergency Procedures
  • Jump to top of the page
© 2009 College of Engineering, University of Michigan