Changes between Version 6 and Version 7 of Tutorials/4G5G/srslte


Ignore:
Timestamp:
Apr 29, 2026, 7:31:50 PM (13 days ago)
Author:
rifatbin
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Tutorials/4G5G/srslte

    v6 v7  
    3030omf tell -a offh -t system:topo:allres 
    3131}}}
    32  For this tutorial we will be using a server srv1-lg1, USRP N310 sdr1-s1-lg1, and sdr2-md1 that has a [https://www.waveshare.com/sim8200-m2.htm Waveshare SIM8200-EA] and Quectel RM510Q-GL attached over USB.
     32 For this tutorial we will be using
     331. As srsran gNb + 5G Core: a server srv1-lg1, USRP N310 sdr1-md1, and
     342. As srsran UE: srv1-in3 that has a [https://www.waveshare.com/sim8200-m2.htm Waveshare SIM8200-EA], or sdr2-md1 that has a  Quectel RM510Q-GL attached over USB.
    3335 1. Load srsran-cosmos.ndz on srv1-lg1
    3436{{{#!shell
     
    3638}}}
    3739{{{#!shell
    38 omf load -i 5G-UE-cosmos.ndz -t sdr2-md1
     40omf load -i 5G-UE-cosmos.ndz -t srv1-in3
    3941}}}
    4042 1. Turn all the required resources on and check the status
    4143{{{#!shell
    42 omf tell -a on -t srv1-lg1,sdr2-md1,sdr1-s1-lg1
     44omf tell -a on -t srv1-lg1,sdr1-md1,srv1-in3
    4345}}}
    4446{{{#!shell
     
    7476
    7577}}}
     78or you can do it manually too:
     79{{{#!shell
     80root@srv1-lg1:~# sudo sysctl -w net.core.rmem_max=25000000
     81root@srv1-lg1:~# sudo sysctl -w net.core.wmem_max=25000000
     82root@srv1-lg1:~# sudo ip link set dev eno1np0 mtu 9000
     83root@srv1-lg1:~# sudo ip link set dev eno2np1 mtu 9000
     84}}}
     85
    7686* With the interfaces configured as above, the server should be able to access the SDRs in the domain. Test with
    7787{{{#!shell
    78 root@srv1-lg1:~# uhd_find_devices --args="addr=10.38.2.1"
     88root@srv1-lg1:~# uhd_find_devices --args="addr=10.39.3.1"
    7989[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; UHD_4.4.0.HEAD-0-g3cf9529f
    8090--------------------------------------------------
     
    8292--------------------------------------------------
    8393Device Address:
    84     serial: 3176DF5
     94    serial: 3196937
    8595    claimed: False
    8696    fpga: XG
    87     mgmt_addr: 10.38.2.1
    88     name: ni-n3xx-3176DF5
     97    mgmt_addr: 10.39.3.1
     98    name: ni-n3xx-3196937
    8999    product: n310
    90100    type: n3xx
     
    15216204/04 21:31:18.189: [amf] INFO: [imsi-310014000000013] Configuration update command (../src/amf/nas-path.c:591)
    153163}}}
    154 * Run connection manager scripts on sdr2-md1 for the modems to establish PDU sessions
    155 {{{#!shell
    156 root@sdr2b-md1:~/SIM8200_code/Goonline# ./simcom-cm
    157 [04-04_16:14:40:249] Build Version: 2020-07-14 10:20:15
    158 [04-04_16:14:40:249] SIMCOM_CM START...
    159 [04-04_16:14:40:249] ./simcom-cm profile[1] = (null)/(null)/(null)/0, pincode = (null)
    160 [04-04_16:14:40:249] Find /sys/bus/usb/devices/2-1 idVendor=2c7c idProduct=0800
    161 [04-04_16:14:40:249] Cannot open directory: /sys/bus/usb/devices/2-1:1.5/net, errno: 2 (No such file or directory)
    162 [04-04_16:14:40:250] Find /sys/bus/usb/devices/2-2 idVendor=1e0e idProduct=9001
    163 [04-04_16:14:40:250] Find /sys/bus/usb/devices/2-2:1.5/net/wwan0
    164 [04-04_16:14:40:250] Find usbnet_adapter = wwan0
    165 [04-04_16:14:40:250] Find /sys/bus/usb/devices/2-2:1.5/usbmisc/cdc-wdm0
    166 [04-04_16:14:40:250] Find qmichannel = /dev/cdc-wdm0
    167 [04-04_16:14:40:251] netcard driver = qmi_wwan
    168 [04-04_16:14:40:254] cdc_wdm_fd = 7
    169 [04-04_16:14:40:342] Get clientWDS = 15
    170 [04-04_16:14:40:374] Get clientDMS = 1
    171 [04-04_16:14:40:406] Get clientNAS = 2
    172 [04-04_16:14:40:438] Get clientUIM = 1
    173 [04-04_16:14:40:470] Get clientWDA = 1
    174 [04-04_16:14:40:502] requestBaseBandVersion MPSS.HI.2.0.c3-00246-SDX55_CPEALL_PACK-1  1  [Oct 26 2020 16:00:00]
    175 [04-04_16:14:40:566] requestGetSIMStatus SIMStatus: SIM_READY
    176 [04-04_16:14:40:598] requestGetProfile[1] cosmos-5G///0
    177 [04-04_16:14:40:630] requestRegistrationState2 MCC: 310, MNC: 14, PS: Attached, DataCap: NR5G
    178 [04-04_16:14:40:662] requestQueryDataCall IPv4ConnectionStatus: DISCONNECTED
    179 [04-04_16:14:40:726] requestRegistrationState2 MCC: 310, MNC: 14, PS: Attached, DataCap: NR5G
    180 [04-04_16:14:41:238] requestSetupDataCall WdsConnectionIPv4Handle: 0xf9438980
    181 [04-04_16:14:41:302] requestQueryDataCall IPv4ConnectionStatus: CONNECTED
    182 [04-04_16:14:41:334] ifconfig wwan0 up
    183 [04-04_16:14:41:339] Fail to access /usr/share/udhcpc/default.script, errno: 2 (No such file or directory)
    184 [04-04_16:14:41:339] busybox udhcpc -f -n -q -t 5 -s /usr/share/udhcpc/default.script -i wwan0
     164* Run connection manager scripts on srv1-in3 for the SIMCOM modem to establish PDU sessions
     165{{{#!shell
     166root@srv1-in3:~/SIM8200_code/Goonline# ./simcom-cm
     167[04-29_19:16:13:901] Build Version: 2020-07-14 10:20:15
     168[04-29_19:16:13:901] SIMCOM_CM START...
     169[04-29_19:16:13:901] ./simcom-cm profile[1] = (null)/(null)/(null)/0, pincode = (null)
     170[04-29_19:16:13:903] Find /sys/bus/usb/devices/4-4 idVendor=1e0e idProduct=9001
     171[04-29_19:16:13:903] Find /sys/bus/usb/devices/4-4:1.5/net/wwan0
     172[04-29_19:16:13:903] Find usbnet_adapter = wwan0
     173[04-29_19:16:13:903] Find /sys/bus/usb/devices/4-4:1.5/usbmisc/cdc-wdm0
     174[04-29_19:16:13:903] Find qmichannel = /dev/cdc-wdm0
     175[04-29_19:16:13:903] netcard driver = qmi_wwan
     176[04-29_19:16:13:911] cdc_wdm_fd = 7
     177[04-29_19:16:13:993] Get clientWDS = 15
     178[04-29_19:16:14:025] Get clientDMS = 1
     179[04-29_19:16:14:056] Get clientNAS = 2
     180[04-29_19:16:14:089] Get clientUIM = 1
     181[04-29_19:16:14:121] Get clientWDA = 1
     182[04-29_19:16:14:153] requestBaseBandVersion MPSS.HI.2.0.c3-00246-SDX55_CPEALL_PACK-1  1  [Oct 26 2020 16:00:00]
     183[04-29_19:16:14:217] requestGetSIMStatus SIMStatus: SIM_READY
     184[04-29_19:16:14:249] requestGetProfile[1] cosmos-5G///0
     185[04-29_19:16:14:281] requestRegistrationState2 MCC: 310, MNC: 14, PS: Attached, DataCap: NR5G
     186[04-29_19:16:14:313] requestQueryDataCall IPv4ConnectionStatus: DISCONNECTED
     187[04-29_19:16:14:377] requestRegistrationState2 MCC: 310, MNC: 14, PS: Attached, DataCap: NR5G
     188[04-29_19:16:14:857] requestSetupDataCall WdsConnectionIPv4Handle: 0x35305740
     189[04-29_19:16:14:920] requestQueryDataCall IPv4ConnectionStatus: CONNECTED
     190[04-29_19:16:14:952] ifconfig wwan0 up
     191[04-29_19:16:14:956] Fail to access /usr/share/udhcpc/default.script, errno: 2 (No such file or directory)
     192[04-29_19:16:14:956] busybox udhcpc -f -n -q -t 5 -s /usr/share/udhcpc/default.script -i wwan0
    185193udhcpc: started, v1.30.1
    186194udhcpc: sending discover
     
    189197
    190198}}}
     199
     200* Configure the ip address of the corresponding interface ("wwan0" here) of srv1-in3:
     201{{{#!shell
     202root@srv1-in3:~# ip a
     2031: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
     204    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
     205    inet 127.0.0.1/8 scope host lo
     206       valid_lft forever preferred_lft forever
     207    inet6 ::1/128 scope host
     208       valid_lft forever preferred_lft forever
     2092: enp3s0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000
     210    link/ether 70:8b:cd:bc:7f:39 brd ff:ff:ff:ff:ff:ff
     2113: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
     212    link/ether 70:8b:cd:bc:7f:38 brd ff:ff:ff:ff:ff:ff
     213    altname enp0s25
     214    inet 10.37.1.5/16 metric 100 brd 10.37.255.255 scope global dynamic eno1
     215       valid_lft 5731sec preferred_lft 5731sec
     216    inet6 fe80::728b:cdff:febc:7f38/64 scope link
     217       valid_lft forever preferred_lft forever
     2184: wwan0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1400 qdisc fq_codel state UNKNOWN group default qlen 1000
     219    link/none
     220    inet6 fe80::de8b:9f9c:f41e:20b4/64 scope link stable-privacy
     221       valid_lft forever preferred_lft forever
     222
     223root@srv1-in3:~# ifconfig wwan0 10.45.0.6/16
     224
     225root@srv1-in3:~# ip a
     2261: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
     227    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
     228    inet 127.0.0.1/8 scope host lo
     229       valid_lft forever preferred_lft forever
     230    inet6 ::1/128 scope host
     231       valid_lft forever preferred_lft forever
     2322: enp3s0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000
     233    link/ether 70:8b:cd:bc:7f:39 brd ff:ff:ff:ff:ff:ff
     2343: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
     235    link/ether 70:8b:cd:bc:7f:38 brd ff:ff:ff:ff:ff:ff
     236    altname enp0s25
     237    inet 10.37.1.5/16 metric 100 brd 10.37.255.255 scope global dynamic eno1
     238       valid_lft 5724sec preferred_lft 5724sec
     239    inet6 fe80::728b:cdff:febc:7f38/64 scope link
     240       valid_lft forever preferred_lft forever
     2414: wwan0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1400 qdisc fq_codel state UNKNOWN group default qlen 1000
     242    link/none
     243    inet 10.45.0.6/16 scope global wwan0
     244       valid_lft forever preferred_lft forever
     245    inet6 fe80::de8b:9f9c:f41e:20b4/64 scope link stable-privacy
     246       valid_lft forever preferred_lft forever
     247root@srv1-in3:~#
     248}}}
     249
     250Notice that "wwan0" interface got the desired IP address 10.45.0.6 now.
     251
     252* Or alternatively, run connection manager scripts on sdr2-md1 for the Quectel modem to establish PDU sessions
    191253{{{#!shell
    192254root@sdr2b-md1:~/quectel-CM_0319# ./quectel-CM -s cosmos-5G
     
    241303}}}
    242304
    243 ==== Throughput test ====
     305==== Throughput test with srv1-in3/SIMCOM Modem ====
     306* Make sure wwan interfaces on srv1-in3 have the right IP addresses obtained above
     307{{{#!shell
     308root@srv1-in3:~# ip a
     3091: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
     310    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
     311    inet 127.0.0.1/8 scope host lo
     312       valid_lft forever preferred_lft forever
     313    inet6 ::1/128 scope host
     314       valid_lft forever preferred_lft forever
     3152: enp3s0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000
     316    link/ether 70:8b:cd:bc:7f:39 brd ff:ff:ff:ff:ff:ff
     3173: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
     318    link/ether 70:8b:cd:bc:7f:38 brd ff:ff:ff:ff:ff:ff
     319    altname enp0s25
     320    inet 10.37.1.5/16 metric 100 brd 10.37.255.255 scope global dynamic eno1
     321       valid_lft 5724sec preferred_lft 5724sec
     322    inet6 fe80::728b:cdff:febc:7f38/64 scope link
     323       valid_lft forever preferred_lft forever
     3244: wwan0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1400 qdisc fq_codel state UNKNOWN group default qlen 1000
     325    link/none
     326    inet 10.45.0.6/16 scope global wwan0
     327       valid_lft forever preferred_lft forever
     328    inet6 fe80::de8b:9f9c:f41e:20b4/64 scope link stable-privacy
     329       valid_lft forever preferred_lft forever
     330
     331}}}
     332"wwan0" interface with ip addrees of 10.45.0.6, so it's good.
     333* iperf3 server
     334{{{#!shell
     335root@srv1-in3:~# iperf3 -s -B 10.45.0.6
     336-----------------------------------------------------------
     337Server listening on 5201
     338-----------------------------------------------------------
     339
     340}}}
     341
     342* iperf3 client on srv1-lg1
     343{{{#!shell
     344root@srv1-lg1:~# iperf3 -c 10.45.0.6 -i 1 -t 50
     345Connecting to host 10.45.0.6, port 5201
     346[  5] local 10.45.0.1 port 43306 connected to 10.45.0.6 port 5201
     347[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
     348[  5]   0.00-1.00   sec  1.78 MBytes  14.9 Mbits/sec   10   40.8 KBytes
     349[  5]   1.00-2.00   sec  1.60 MBytes  13.5 Mbits/sec    5   46.1 KBytes
     350[  5]   2.00-3.00   sec  2.04 MBytes  17.1 Mbits/sec    0   71.1 KBytes
     351[  5]   3.00-4.00   sec  2.10 MBytes  17.6 Mbits/sec    3   71.1 KBytes
     352[  5]   4.00-5.00   sec  1.97 MBytes  16.6 Mbits/sec    8   52.7 KBytes
     353[  5]   5.00-6.00   sec  1.97 MBytes  16.6 Mbits/sec    1   54.0 KBytes
     354[  5]   6.00-7.00   sec  2.16 MBytes  18.1 Mbits/sec    7   54.0 KBytes
     355[  5]   7.00-8.00   sec  1.85 MBytes  15.5 Mbits/sec    2   57.9 KBytes
     356[  5]   8.00-9.00   sec  1.91 MBytes  16.0 Mbits/sec    3   61.9 KBytes
     357[  5]   9.00-10.00  sec  1.67 MBytes  14.0 Mbits/sec    6   46.1 KBytes
     358[  5]  10.00-11.00  sec  1.85 MBytes  15.5 Mbits/sec    3   52.7 KBytes
     359[  5]  11.00-12.00  sec  2.16 MBytes  18.1 Mbits/sec    3   54.0 KBytes
     360[  5]  12.00-13.00  sec  1.97 MBytes  16.6 Mbits/sec    1   52.7 KBytes
     361[  5]  13.00-14.00  sec  2.16 MBytes  18.1 Mbits/sec    3   54.0 KBytes
     362[  5]  14.00-15.00  sec  1.97 MBytes  16.6 Mbits/sec    1   55.3 KBytes
     363[  5]  15.00-16.00  sec  2.04 MBytes  17.1 Mbits/sec    2   56.6 KBytes
     364[  5]  16.00-17.00  sec  1.79 MBytes  15.0 Mbits/sec    2   61.9 KBytes
     365}}}
     366...
     367{{{#!shell
     368[  5]  45.00-46.00  sec  2.04 MBytes  17.1 Mbits/sec    1   51.3 KBytes
     369[  5]  46.00-47.00  sec  1.91 MBytes  16.0 Mbits/sec    2   52.7 KBytes
     370[  5]  47.00-48.00  sec  1.97 MBytes  16.6 Mbits/sec    3   55.3 KBytes
     371[  5]  48.00-49.00  sec  1.91 MBytes  16.0 Mbits/sec    3   55.3 KBytes
     372[  5]  49.00-50.00  sec  1.97 MBytes  16.6 Mbits/sec    1   60.6 KBytes
     373- - - - - - - - - - - - - - - - - - - - - - - - -
     374[ ID] Interval           Transfer     Bitrate         Retr
     375[  5]   0.00-50.00  sec  99.0 MBytes  16.6 Mbits/sec  149             sender
     376[  5]   0.00-50.06  sec  98.7 MBytes  16.5 Mbits/sec                  receiver
     377
     378iperf Done.
     379root@srv1-lg1:~#
     380}}}
     381
     382Meanwhile you can also check the gNb trace to see more relevant information like pci, rnti, cqi, ri rsrp etc.
     383
     384{{{#!shell
     385root@srv1-lg1:~# gnb -c ~/srsRAN_Project/configs/gnb_rf_n310_tdd_n41_20mhz.yml
     386
     387--== srsRAN gNB (commit 40b17b429) ==--
     388
     389
     390The PRACH detector will not meet the performance requirements with the configuration {Format B4, ZCZ 0, SCS 30kHz, Rx ports 1}.
     391Lower PHY in quad executor mode.
     392N2: Connection to AMF on 127.0.0.5:38412 completed
     393Cell pci=1, bw=20 MHz, 1T1R, dl_arfcn=518670 (n41), dl_freq=2593.35 MHz, dl_ssb_arfcn=517710, ul_freq=2593.35 MHz
     394
     395Available radio types: uhd and zmq.
     396[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; UHD_4.4.0.HEAD-0-g3cf9529f
     397[INFO] [LOGGING] Fastpath logging disabled at runtime.
     398Making USRP object with args 'type=n3xx,addr=10.39.3.1,master_clock_rate=122.88e6,send_frame_size=8000,recv_frame_size=8000'
     399[INFO] [MPMD] Initializing 1 device(s) in parallel with args: mgmt_addr=10.39.3.1,type=n3xx,product=n310,serial=3196937,name=ni-n3xx-3196937,fpga=XG,claimed=False,addr=10.39.3.1,master_clock_rate=122.88e6,send_frame_size=8000,recv_frame_size=8000
     400[INFO] [MPM.PeriphManager] init() called with device args `fpga=XG,master_clock_rate=122.88e6,mgmt_addr=10.39.3.1,name=ni-n3xx-3196937,product=n310,recv_frame_size=8000,send_frame_size=8000,clock_source=internal,time_source=internal'.
     401[WARNING] [0/Radio#0] Attempting to set tick rate to 0. Skipping.
     402==== gNB started ===
     403Type <h> to view help
     404t
     405
     406          |--------------------DL---------------------|-------------------------UL------------------------------
     407 pci rnti | cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  rsrp  mcs  brate   ok  nok  (%)    bsr     ta  phr
     408   1 4607 |  15   1   28    18M  614    0   0%  12.5k |  23.5 -43.1   28   207k   53    0   0%      0    89n   30
     409   1 4607 |  15   1   28    16M  546    0   0%  12.5k |  23.6 -43.0   28   218k   50    0   0%      0    89n   30
     410   1 4607 |  15   1   28    17M  586    0   0%  4.09k |  23.4 -43.1   28   209k   52    1   1%     74    56n   38
     411   1 4607 |  15   1   28    15M  522    0   0%  1.28k |  23.5 -43.2   27   188k   61    0   0%      0   130n   30
     412   1 4607 |  15   1   28    16M  546    0   0%    21k |  23.7 -43.0   28   218k   50    0   0%      0   105n   30
     413   1 4607 |  15   1   28    19M  619    0   0%    21k |  23.7 -43.1   28   218k   50    0   0%      0    73n   30
     414   1 4607 |  15   1   28    18M  612    0   0%    21k |  23.5 -43.1   28   218k   50    0   0%      0    73n   30
     415   1 4607 |  15   1   28    18M  600    0   0%    21k |  23.7 -43.1   28   218k   50    0   0%      0    89n   30
     416   1 4607 |  15   1   28    19M  622    0   0%  9.72k |  23.7 -43.1   28   218k   50    0   0%      0    97n   30
     417   1 4607 |  15   1   28    16M  555    0   0%  4.09k |  23.6 -43.0   28   218k   50    0   0%      0   211n   30
     418   1 4607 |  15   1   28    18M  601    0   0%  32.2k |  23.8 -43.0   28   218k   50    0   0%      0   130n   30
     419
     420          |--------------------DL---------------------|-------------------------UL------------------------------
     421 pci rnti | cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  rsrp  mcs  brate   ok  nok  (%)    bsr     ta  phr
     422   1 4607 |  15   1   28    18M  603    0   0%  12.5k |  23.5 -43.0   28   218k   50    0   0%      0   113n   30
     423   1 4607 |  15   1   28    19M  618    0   0%    21k |  23.7 -43.0   28   218k   50    0   0%      0   268n   30
     424   1 4607 |  15   1   28    19M  635    0   0%  32.2k |  23.6 -43.0   28   218k   50    0   0%      0   252n   30
     425   1 4607 |  15   1   28    17M  577    0   0%  9.72k |  23.5 -43.0   28   218k   50    0   0%      0   170n   30
     426   1 4607 |  15   1   28    19M  633    0   0%  29.4k |  23.6 -43.0   28   218k   50    0   0%      0   187n   30
     427   1 4607 |  15   1   28    17M  563    0   0%  29.4k |  23.6 -43.0   28   218k   50    0   0%      0    32n   30
     428   1 4607 |  15   1   28    17M  551    0   0%  26.6k |  23.6 -43.0   28   218k   50    0   0%      0    65n   30
     429   1 4607 |  15   1   28    19M  618    0   0%  12.5k |  23.6 -43.0   28   218k   50    0   0%      0   -81n   30
     430   1 4607 |  15   1   28    19M  647    0   0%      0 |  23.7 -43.0   28   218k   50    0   0%     53    16n   30
     431   1 4607 |  15   1   28    15M  492    0   0%    21k |  23.5 -43.1   28   204k   54    0   0%      0   -16n   30
     432   1 4607 |  15   1   28    17M  581    0   0%  12.5k |  23.7 -43.0   28   218k   50    0   0%      0    89n   30
     433}}}
     434
     435
     436==== Throughput test with sdr2-md1/Quectel Modem ====
    244437* Make sure wwan interfaces on sdr2-md1 have the right IP addresses obtained above
    245438{{{#!shell