Article Index

Performance and Benchmarks

Test Systems and Methodology

Since this review focuses on a standalone Internet Gateway and its suitable Broadband Internet Service. The product is not reliant on the performance of client-connected computers so performance should be consistent regardless of the specification.

Client PCs used to benchmark performance and throughput comprised of mainly white-box and DELL systems with Intel Pentium 4 or AMD Athlon processors running Windows XP SP3.

For testing the performance and connectivity of the Wireless-G LAN, we used the following Wireless-G PCI desktop adapters in our test machines with the latest drivers available at time of testing

Netgear WG311T PCI Wireless Adapter– Atheros AR5001X chipset

D-Link DWL-G510 PCI Wireless Adapter – Ralink RT61 chipset

To test the performance of this Internet Gateway and the 3G Broadband Internet Connection that the device utilises, we used the following tools for synthetic and real-world benchmarking

  • http://www.speedtest.net/
  • http://www.ozspeedtest.com/
  • IPerf network benchmark tool with Networkworld magazine’s test script

The Iperf settings to test TCP/IP throughput used were as follows:

(client) iperf -c <client IP address> -w 128k -i .5 -r -t 90 (server) iperf -s -w 128k

  • File Upload and Download tests from local network and internet sources via FTP, 2MB Digital camera Photo JPEG file used, Windows command line FTP client. Either FileZilla FTP server for Windows or Unix/Linux FTP Server on the
  • Latency tests using the PING tool

The average of three passes are taken and used, which we represent in our tabular results and charts.

When testing the 3G Internet connection, best effort was made to ensure that the internet connection was running in the highest possible speed band and signal strength, being 3.5G HSPA of theoretical maximum 7.2Mbit/s down and 2Mbit/s up, however at times the connection would fallback to slower 3G speeds of 3.6MBit/s down.

When testing the Wireless-G (Wi-Fi) Network connection, we used the default Wi-Fi Security settings in the Gateway being WPA-PSK Security using TKIP Encryption. This setting matches the default Wi-Fi Settings in Windows XP SP3.

Ralink Wireless Utility

Benchmarks

3G Internet performance benchmarks - Wired and Wireless Connection

This particular Gateway has been branded and configured by default to only operate on the Telstra Network [who are major Australian telecom provider] . The operation modes for best performance are 3G UMTS or 3.5G HSPA modes on either the 850MHz WCDMA band or the 2100MHz WCDMA band.

WCDMA 850 with HSPA offers the best performance, up to 5MBit/s of actual throughput out of 7.2Mbit/s theoretical maximum.

Our test unit seemed rather sensitive and due to the specifics of the units firmware the user is only able to forcibly select what frequency band they wish for the cellular modem in the Gateway to operate at, as such whether the unit operates in 3G or 3.5G is depending on signal strength, location and the weather, literally.

Signal Strength and the capability of the cell site to the user is critical for mobile broadband users to achieve good throughput and latency without dropouts.

We endeavoured to ensure that our 3G performance testing was performed under optimal conditions so we tested performance at several locations within the Sydney Metropolitan area and the Sydney Central Business District.

From our testing we recorded the best throughput possible with maximum signal strength and conditions as well as typical scenarios where medium strength and throughput is achieved with the possible 3G Modes and Frequency bands that the unit supports for a 3G Mobile broadband Connection.

The 2G/2.5G GPRS connection mode, which is to be used in locations where there is no 3G reception, was not performance tested.


Sydney Suburban location connected to Telstra ‘NextG’ Network in 3G UMTS mode on 850 MHz Band with full signal strength.

3G9WT web interface

Throughput - FTP transfer

Photo JPEG Test 2MBWi-Fi to TPG ISP ISP (KB/s)Wi-Fi to NitroWare.net FTP (KB/s)
FTP Download Avg. 232.8 140.7
FTP Upload Avg. 111.2 55.6

speedtest.net online throughput test

ozspeedtest.com Internet throughput test

 

Sydney Bigpond mirrorTime (s)Line Speed (kbps)Download Speed (KB/s)
70KB 0.38 1530 191
600KB 4.42 1104 138
9MB 87.13 868 108
Sydney Optus MirrorTime (s)Line Speed (kbps)Download Speed (KB/s)
3MB 20.39 1201 150

Latency - Internet sites

PING latency testApproximate round trip times
in milliseconds: Average ms
URLWired EthernetWi-Fi 54g
google.com 321 330
iinet.net.au 163 303
maps.google.com.au [Akami content servers] 280 256
NitroWare.net 445 549
pipenetworks.com 289 117
trailers.apple.com [Akami content servers] 97 248
webcentral.com.au 144 156

Sydney Suburban location connected to shared 3-Telstra Network in 3.5G HSPA mode on 2100MHz band with full signal strength

Photo JPEG Test 2MBWired to TPG ISP FTP (KB/s)Wi-Fi to TPG ISP FTP (KB/s)Wired to NitroWare.net FTP (KB/s)
FTP Download Avg. 265.2 243.5 163.6
FTP Upload Avg. 121.3 45.2 38.1

Sydney Suburban location connected to Telstra ‘NextG’ Network in 3.5G HSPA mode on 850MHz band with full signal strength

3G download test3G download test

Sydney CBD location connected to Telstra ‘NextG’ Network in 3.5G HSPA mode on 850MHz band with full signal strength

3G9WT web interface3G9WT web interface3G9WT web interface

Photo JPEG Test 2MBWired to TPG ISP FTP (KB/s)Wired to NitroWare.net FTP (KB/s)
FTP Download Avg. 382.3 172.2
FTP Upload Avg. 130.8 49.4

speedtest.net Internet performance test

ozspeedtest.com Internet performance test

Bigpond mirrorTime (s)Line Speed (kbps)Download Speed (KB/s)
3MB 33.56 730 91
TPG Mirror      
3MB 8.22 2980 373

Wireless-G (Wi-Fi) Local Area Network performance

Since this Gateway features only standard Wi-Fi functionality and is it advertised as a high peed wireless device, we conducted minimal Wi-Fi testing only to confirm that the performance is satisfactory. We tested at a range of five meters.

TestWireless to Wired (KB/s)Wireless to Wireless (KB/s)
FTP Download Avg. 2777.3 1329.0
FTP Upload Avg. 1650.3 1158.0
 Wireless to Wired (Mbit/s)Wireless to Wireless (Mbit/s)
Iperf Avg. 24.9 12.5

What do all these benchmarks mean?

3G Mobile Broadband, like Wi-Fi has large transmission overheads meaning that the advertised speed on the box, whether it is 7.2Mbps, 2Mbps, or 300Mbps are link speeds and not throughput speeds. For each real piece of data a user wants to transmit such as a document or photo, there is significant overhead on top of that file size due to the hardware and software needing to compensate for errors in the data stream through the air and having to retransmit that data as well as keeping track of information related to which access points or base stations the user is roaming between.

An analogy would be of a road that is sign posted with a 100KPH speed limit in rush hour but due to the congestion of all the cars trying to progress not one car is able to achieve the signposted speed due to the congestion and restrictions imposed upon each vehicle. Along with the 'box' and marketing specifications of 7.2mbps down and 2mbps up, Telstra do advertise real-world achievable speeds of "550kbps to 3mbps downlink with 6mbps bursts and uplink speeds of 300kbps to 1mbps with 1.3mbps bursts".

We easily achieved these 'real-world' speeds in several of our tests and exceeded them on several occasions, with the maximum downlink speed we achieved in the 400KB/s range with uploads in the 100KB/s range repeatedly and consistently provided the gateway connected in the optimal 3.5G HSPA mode. 3G yielded slower speeds as expected.

This speed is equivalent to a 4mbps/1mbps DSL or Cable broadband service, which is impressive considering it is using the public cellular network. We were able to replicate the promised speeds advocated by Telstra and of what we expected to see.

Early previews of 14mbps and 21mbps 3.5G HSPA products seen by NitroWare.net indicate that performance for connections which these link speeds are excess of 5mbps so this also affirms the results we achieved.

Unfortunately these maximum speeds are only possible if you like in an area [of Australia] with good 3G signal strength and is enabled for 3.5G HSPA and Telstra do advocate that the higher speeds are only available in specific areas such as Central Business Districts or Metropolitan areas or otherwise. Users should check whether the area they wish to use is 3.5G HSPA enabled.

While throughput can be very good, we found the latency to internet sites via Wired or Wi-Fi connection to be average which is to be expected for wireless networking. Some readers may see the latency results as poor but one must consider the factors at play, that wireless whether its WAN or LAN will always have high latencies, the distance of hundreds of metres or kilometres the cellular signal needs to travel, physical obstacles and the weather.

The mixed nature of 3G Internet is what leads to the inconsistency in some our results. We found it challenging to replicate the same result on a consistent basis especially when the signal strength(speed) or 3G mode changes on the fly

2018-09-21 | NVIDIA QUADRO RTX 6000 In action - Photoshop, Porsche RTX, Kubernetes, CLARA and Metropolis


2018-09-20 | NVIDIA RTX Live Demo - Ray Traced Porsche on Turing GPU


2018-09-21 | EPSON goes bright with laser projection and 4K


2018-09-15 | 8 NVIDIA TESLA V100 VOLTA GPU server from HP


2017-12-31 | Future of Networking with Extreme Networks - Eric Broockman CTO Interview


2018-02-16 | NVIDIA’S VOLTA is real, it works and it is finally here.


2018-02-07 | motorola harbourside chat and interview | moto x4, g5s plus, 360 camera & gamepad


2018-02-07 | Inwin X-Frame product tour and interview


2018-02-07 | ASUS Zenbook 3 Deluxe UX490 Ultrabook


2017-11-20 | VICHYPER - Australian Hyperloop Interview and Tour


2017-11-17 | Eugene Kaspersky & Kaspersky Lab Press Conference Sydney 2017


2017-11-17 | Eugene Kaspersky Keynote Sydney 2017


2017-05-21 | AMD RYZEN - Australian launch and Q&A Session | BIOS Update Detailed


2016-11-21 | Motorola Mobility VP Engineering Interview | Moto Z and Moto Mods Developer Kit for Makers & Modders


2016-11-30 | EPSON Tech Interview | 2016 Business and Professional Projectors


2016-11-30 | EPSON Tech Interview | 2016 Home Theatre Projectors 6000, 8000 & 9000 Series


2016-11-22 | EPSON HDR Home Theatre Projector Demo | EPSON TW9300W


2016-11-21 | HDR video Demo - AMD Radeon 'Polaris' RX480 with LG OLED TV


2016-11-30 | Intel Game Chamber 2016 Tour and Interviews | VR, Games, PC Mods, Overclocking and FUN


2016-11-30 | Intel Core i7-6950X Broadwell-E @ 5.62 GHz Live Overclock | Intel Game Chamber 2016


2016-08-29 | LG puts OLED in all the things - Integrate/CEDIA AUS 2016 Booth Tour


2016-08-12 | What is Software Defined Networking with Doug Murray, CEO Big Switch Networks.


2016-06-17 | NVIDIA DGX-1 launches in Australia - NVIDIA ANZ Interviewed


2016-05-01 | Build a kickass Dolby ATMOS Home Theatre - The Pros show us how


2016-04-01 | The Panasonic Toughbook CF-20 Story


2016-03-23 | Seagate 8TB Family, 10TB Helium & Mobile HDD 2016 Hard Disk Update


2016-03-21 | Panasonic Toughbook 20 : Fully Rugged detachable Laptop launch - Water, Drop & Weight Tested


2016-03-23 | ASUS ROG Gaming House Tour - Sydney, Australia


2016-03-01 | ASUS ROG GX700 Liquid Cooled Notebook Preview & Interview


2016-03-23 | League of Legends Legacy eSports Team Interview


2015-12-09 | Microsoft Store SYDNEY - Grand Opening Press Conference


2015-11-11 | HP 6th Gen Core Intel Skylake PC & Jet Intelligence Printing Launch - Melbourne Experience Centre


2015-11-11 | HP Experience Centre Melbourne Tour -Part 2


2015-11-11 | HP Experience Centre Melbourne Tour -Part 1


2015-08-28 | Parrot Interviewed - Flower Power Wireless Plant Monitor


2015-08-28 | Parrot Interviewed - ZiK 2.0 Headphones


2015-08-28 | Parrot Interviewed - AR. Drone, MiniDrones, Bebop Drone


2015-08-23 | MOTO G 3rd Gen IPX7 Water Proofing Demo & Moto X Style/Play/G Q&A


2015-08-21 | Motorola Mobility Interviewed - 3rd Gen Moto G, Moto X Play, Moto X Style


2015-08-20 | NVIDIA GEFORCE GTX 950 Launch Ep.1 | Gamestream Co-Op - A New way to share games


2015-08-20 | NVIDIA GEFORCE GTX 950 Launch Ep.2 | MOBA/DOTA 2 Latency and Smoothness


2015-08-08 | Intel SKYLAKE i5-6600K LN2 overclock at 6.33 GHz with ASUS Z170 ROG Hero


2015-08-07 | Intel Skylake i7-6700K @ 4.8 GHz & DDR4 @ 3.5GHz on ASUS Z170 Deluxe Overclocking Guide


2015-08-05 | ASUS Z170 Deluxe Motherboard for Intel Skylake 6th Gen Core CPU Overview


2015-08-05 | Review - ASUS Installation Tool for Intel SKYLAKE 6th Gen Core CPU


2015-08-02 | HP Pavilion and Envy 2015 Consumer Notebook First Look


2015-07-25 | HP Envy Phoenix 2015 Overclockable Gaming Tower First Look


2015-07-22 | Ashes Of The Singularity - DirectX 12 Hands-On Demo with AMD FURY X


2015-07-14 | Media Q&A with AMD and Richard Huddy - AMD Fury X ‘Fiji’ Graphics comes to Australia


2015-07-14 | MSI Interview - AMD Radeon R9 300 Gaming, Armour and Lightning GPUs