Category: Uncategorized

How do you know your change won’t cause problems to network? Traditional network engineering relies on robust Change Review processes plus CCIE-level knowledge combined with smart-hands to ensure that. More modern approaches aim to solve this problem with a DevOps mindset that would include multiple layers of testing.

In Networking it’s very expensive to have an environment like production for testing. One possible approach is having some type of a virtual networking lab. We’ve been playing around with an opensource tool called Netsim-tools and below we give an overview of the tool and describe the installation process.

Netsim-tools is bringing IAC to your networking labs. Instead of wasting time creating lab topology in a GUI and configuring boring details, you’ll start with a lab preconfigured according to your specifications. Netsim allows you to:

• Describe high-level lab topology in YAML format without worrying about the specific implementation details
• Use the same lab topology with multiple virtualization providers (Virtualbox, KVM/libvirt, Docker containers)
• Create Vagrant configuration files and Ansible inventory from the lab topology

In a future post, we will create an actual topology, for now, let’s focus on the installation procedure.

• Arista vEOS
• Cisco IOSv
• Cisco CSR 1000v
• Cisco Nexus 9300v
• Cumulus Linux
• Cumulus Linux 5.0 (NVUE)
• Fortinet FortiOS
• FRR 7.5.0
• Generic Linux host
• Juniper vSRX 3.0
• Mikrotik CHR RouterOS
• Nokia SR Linux
• Nokia SR OS
• VyOS
• Dell OS10

Read more about supported devices in:
netsim-tools.readthedocs

Installation

Now, let’s install the Netsim. The install process are automated, you can copy and paste this script on your Ubuntu 20.04, but some requirements are indispensable:

Server requeriments:
• 4 CPUs
• 8 GB MEM
• 64 GB Disk
• Ansible
• Python3 with pip

Please read the comments and adjust to yours needs, but if you have a new server or if you can remove old versions of Python and Ansible, maybe be the better way.

Installation with Ansible:

# you can copy/paste and run all this text.
# you can choose not update your system and Python
# but we recommend to do this to avoid some troubles with Ansible

# can you update your system? uncomment this step
# apt update && apt -y upgrade && apt -y autoremove

# can you update your Python? uncomment these two step under
# apt remove -y python3 ansible ansible-core 
# apt install python3-pip

# adjust the step "ADJUSTING TIME TO AVOID ISSUE" to your timezone if the script do not work

# Update your pip and install Ansible to run de playbook
pip install --upgrade pip
pip install ansible ansible-core

# create playbook in netsim-install.pb file
cat > netsim-install.pb << EOF
---
- hosts: localhost
  gather_facts: no
  tasks:
    - name: "[ UPDATING SYSTEM PACKAGES ]"
      apt:
        update_cache: yes
        upgrade: full
        autoremove: yes
      register: aptout

    - name: "[ INSTALLING DEPENDENCIES OF NETLAB ]"
      apt:
        name: "{{ pkgs }}"
        state: present
      vars:
        pkgs:
          - python3-pip
          - vagrant-libvirt

    - name: "[ UPDATING PIP ]"
      shell:
        cmd: "pip install --upgrade pip"

    - name: "[ INSTALLING NETSIM-TOOL WITH PIP  ]"
      pip:
        name: "netsim-tools"

    - name: "[ INSTALLING NETLAB PACKAGES ]"
      shell:
        cmd: "netlab install -y ubuntu ansible libvirt containerlab"

    - name: "[ ADJUSTING TIME TO AVOID ISSUES ]"
      shell:
        cmd: "timedatectl set-timezone $(cat /etc/timezone) && timedatectl --adjust-system-clock"

    - name: "[ TESTING KVM LIBVIRT SUPPORT ]"
      shell:
        cmd: "kvm-ok"
      register: kvmout
      ignore_errors: True

    - debug:
        msg: "{{ kvmout }}"
EOF
# run the PB and run the netlab test if PB pass
ansible-playbook ./netsim-install.pb && netlab test libvirt

We really expect that you reach theses objectives and get something like this:

When Netsim(netlab) script finishs, automatically the lab its detroyed, evidencing that all requirements are done. Well, its that all, good run and enjoy!

fonts:
https://github.com/ipspace/netsim-tools
https://netsim-tools.readthedocs.io

Leave a Comment

Hi Everybody, I just want to write a little bit about my recent career updates and what I’ve been up to. In the last couple years I’ve had a growing interest in finance and investments which led me to take a Machine Learning for Trading course on Coursera and then proceed to read a lot on the subject. Special remarks to the book Dao of Capital which is definitely one of my top 5 favorite books.

Since I was spending so much time reading about finance, I decided to take classes part-time on the subject. So far I have taken a stochastic processes for finance class at Georgia Tech and an Advanced Machine Learning class at NYU as a visiting student; these classes have been absolutely amazing!

Anyway, at this point I’m not sure I’d transition my career to finance, but I definitely want to learn more about it so I decided to apply for networking jobs at finance companies. By extreme luck I was able to interview for a position to which I think I’m a perfect fit. Every time I talked to an engineer at this company I became more interested about the opportunity. I finally got an offer and was thrilled to join the Systems Dev team at Hudson River Trading (HRT) as a network automation engineer.

For those who are not familiar, a quick Wikipedia search will say that “HRT is a class quantitative trading firm, and more specifically a high-frequency trading (HFT) firm. According to the Wall Street Journal, it is responsible for about 5% of all stock trading in the United States.”

I started only one week ago, but I’m absolutely excited because I already see state-of-the-art and bleeding edge technologies left and right. Their engineering environment is one of the most complex I was ever exposed to and the technical challenges are amazing. And when I say complex, I don’t mean process complexity or people complexity, I mean technical complexity, which is every engineer’s paradise.

In many ways this opportunity is perfect for me since it allows me to progress on my career as a network automation engineer and at the same time learn more about the finance industry. To top it up, I’m also working with amazing engineers and managers. I’ll try to write about that later.

Anyway, that’s all folks! Ciao!

Leave a Comment

Last Friday was my last day working as a Network Automation Engineer at Cargill. Words can’t describe how grateful I am for spending 2020 with them. For those who don’t know, according to Forbes, Cargill is the 2nd largest private US company, primarily in the food and agriculture industry. I was asked many times why would they need network automation engineers?

Cargill runs an immense network and as every other network, it needs to be managed properly. I really cherished the opportunities I got to get exposed to technologies I wasn’t super familiar with such as Jenkins and Batfish while, at the same time, mentoring other engineers on Ansible implementations.

I was really impressed with the overall integrity and high level of excellence of Cargill. Even though they are not a tech company, their container platform is the best I’ve ever worked with so far. Additionally, they are really good at agile practices, ensuring developers deliver their best. More than anything, I cherish the incredible connections I made while working there and I hope I’ll keep for life.

This event and other things got me thinking. This year it’s going to be 5 years since I’ve gotten my Master’s degree in Computer Science and 7 since I made my permanent move to the USA. Many things happened in my life recently that deserve appreciation.

In 2014, I’ve obtained my Bachelors of Science degree in Telecommunication Networks Engineering from Brazil, it took me six years to get that degree because I almost gave up on it on my 5th year. That degree plus other experiences gave me a very strong quantitative background. I did not get exposed to as many technologies as I’d like to but I got exposed to many fundamental problems that are extremely relevant to engineering. In hindsight, I value that experience way more than I did a few years ago. More than that, some of the smartest individuals I met in my life happened during that time.

During my Master’s in the US I dove deep in the research area of Software-Defined Networks. Similarly, initially through Georgia Tech, I had the opportunity to encounter individuals who I admire a lot and once thought were legends such as Vint Cerf, Bob Kahn, Larry Peterson. It was mind boggling to know these guys were real people. Georgia Tech was the environment in which I was most productive and focused in all of my life so far. It’s a tough school, but every minute you spend at Georgia Tech was worth it for me. While at GT I also worked for ONF, that experience itself could lead to a whole new blog post, so I’ll just admit that I’m neglecting them in this specific post. Work wise, ONF has been the most significant job experience for me, so far.

After that, I directed my career to Network Automation and worked for 3 companies, Verizon, PayPal and Cargill. Right now I feel like I owe Verizon, PayPal and ONF their dedicated posts. I might write another one soon. For now, I’m just going to say that I’m quite happy with where all those experiences brought me and I’m very grateful for all I learned so far.

I’m in the last steps of figuring out where I’m going next. I’ll keep you all posted.

Cheers!

Leave a Comment

In this post, I want to discuss a couple of the choices one can have when it comes to placing Ansible variables. The docs for variable precedence state 22 where variables can be defined and the order of precedence that the program applies.

Does that mean you should use all of them? Nope. Although each of one of them has its own use case, I usually vouch for implementation simplicity: less is better.

Here is the list I’d recommend:

• role defaults
• inventory group_vars
• inventory host_vars
• role vars

I usually do not use other types of variables and I’d not recommend doing so. I reiterate that they can all be useful, but, in my opinion, relying mostly on your inventory variables, reduces the complexity significantly. Which leads to time savings when it comes to troubleshooting and other things.

I remember many times where I spent days working on a bug that was introduced due to a misplaced.

Think of it this way: For every additional layer, you are adding more opportunity for the system to break. For example, one time when we writing playbooks for upgrading OS on a networking device we stipulated that some tasks of the playbook should use a different password, and we thus hardcoded those variables as task vars. For some reason, in production someone was inputting the password variables with more precedence and thus breaking the code. Now, I could argue that the person inputting the password was making a mistake. But in hindsight I’d say the mistake was allowing this complexity to take place at all.

So if you have N layers, you can have O(N^2) possible conflicts. Which means that troubleshooting this can be a nightmare. Ansible developers have experience with this and know how to navigate it, but still why even bother if you could prevent it.

Again, let’s say you wrote your code so that it uses block variables. But then the user wants to overwrite some behavior by setting variables using include_vars? That could mean that you are in uncharted territory, meaning that the code wasn’t tested for this use case…

Role defaults vs Role vars

One pattern that I’ve been using when writing roles using role defaults as an example of how to configure your role. Similar to what is used here:

---
# defaults file for ansible-frr
frr_daemons:
  bgpd: false
  isisd: false
  ldpd: false
  nhrpd: false
  ospf6d: false
  ospfd: false
  pimd: false
  ripd: false
  ripngd: false
  zebra: true

I like to use Role vars when something must be hardcoded. Such as your data model schema. Let’s say the dictionary frr_daemons, must have entries for bgpd. Then I like to put an entry in vars that explicitly defines that and I also add a task on the beginning of my role to check if the inputs are given.

---
# Must have children in variables
Children:
  frr_daemons_: [ 'bgpd' ]

This can get out of hand quick, but usually it works out

Conclusion

In summary, I believe you can place your Ansible variables in the 4 locations listed below. And if you avoid placing variables in any other place you’ll save yourself a lot of troubleshooting time. I’d love to hear if you can think of a usecase to which this example doesn’t suffice.

• role defaults
• inventory group_vars
• inventory host_vars
• role vars

Please comment below, or PM me on the slack channel from the networktocode folks, my username is castroflavio.

Leave a Comment

What’s going on? While working on datacenter networking automation for PayPal this past year, I noticed how much more effective some development teams are when they have a good product manager and that piqued my curiosity. I realized I always spend a good amount of time asking why the work is done before doing it and this is one of the characteristics of a product manager.

Last week, I joined a Bootcamp on Product Management at General Assembly. My goal in joining this Bootcamp is to dive into the subject and understand how product management brings value to the team. Along the way, I hope to acquire some skills to help me be more effective at my job.

In this article, I’m going to list the reading recommendation for the first week of the bootcamp and write a reading summary:

Here is the list of articles:

• Good PM/Bad PM by Ben Horowitz and David Weiden (3.5 stars)
• What’s Your Problem (Parts 1 and 2 only) by Matt Lavoie ( 5 stars!)
• The Five Components of a Good Hypothesis by Teresa Torres (4 stars)
• A Product Manager’s Job by Josh Elman (3 stars)
• Product Management vs. Product Marketing by Marty Cagan (4.5 stars)
• Product Management vs. Project Management by Marty Cagan (3 stars)
• When You’re Innovating, Resist Looking for Solutions by the Harvard Business Review (haven’t read yet)

Good PM/Bad PM by Ben Horowitz and David Weiden – 3.5 stars

Good article that does a good job at densely describing what a good product manager does, and cautions about what a bad product manager does as well.Highlights of a Good PDM:

Clearly defines requirements. The definition is based on research, information and a logical transparent process. This definition empowers engineering to fill the technical gaps, rather than pushing a vision downwards, it builds it’s vision gathering information informally from engineering.
Knows what it takes to make it’s product successful and it defines that in writing.

Doesn’t rest until product vision is consistent across all teams.

What’s Your Problem (Parts 1 and 2 only) by Matt Lavoie – 5 stars

Incredible article that focuses on explaining why defining a problem statement is crucial for the success of an endeavor rather than jumping into solutions as we Engineers usually do. I like that it’s a fun read, yet concise and effective in pushing its point across. Highlights:

With a problem statement, there is no feature creep. There’s a problem and a measurable outcome.
If we believe something will get to that outcome and we can create an experiment to prove it, we should work on it.

By not taking a moment to identify the problem, your implementation won’t be as successful as it could be.

Outcome-driven teams, know when they are successful by utilizing measurement with our output to know that we reached our desired outcome.

The Five Components of a Good Hypothesis by Teresa Torres – 4 stars

Solid reading that describes why one should define good hypothesis for it’s work to be effective. I actually like the format that she criticizes in a later article: How to Improve Your Experiment Design (And Build Trust in Your Product Experiments). Which is the Lean Startup format:

We believe [this capability]
Will result in [this outcome]
We will have confidence to proceed when [we see these measurable signals]

I like it better because its action driven. I can see that depending on the problem her hypothesis template would be more accurate, but the Lean Startup one is lean, it only has the essential to get you moving.

A Product Manager’s Job by Josh Elman – 3 stars

Good read, but unimpressive honestly. It just expands on his vision of the PDM’s job: “Help your team (and company) ship the right product to your users”. Which is true. I think it still needs insights on how this can be achieved for this information to be relevant to me

Product Management vs. Product Marketing by Marty Cagan – 4.5 stars

Great read, and it describes what the author think should be the two complementary roles needed to launch a product. The author states that often the two roles are assigned to the same person even though people usually are focuses in one aspect or the other and that often creates a gap.

Product Management vs. Project Management by Marty Cagan (5/10)

Good read but unimpressive.

This is all for now folks, I’m excited and I’ll try to write a blog post weekly about this new experience.

Leave a Comment