Friday 21 June 2013

MUSINGS: About Those USB Cable Tests...

Back in April, I posted my USB cable tests (note this was updated recently with the TEAC DAC & Belkin Gold results). To recap, basically I could not find significant analogue output differences between a few cables despite differences in construction and lengths - including one of which consisting of 2 cable extenders and totaling 17 feet in length. The analogue output from the DAC did not show significant change in frequency response, distortion, noise levels, or jitter whether the USB cable was used to feed an asynchronous USB-to-SPDIF device (the CM6631A), directly to an older adaptive isochronous DAC (AUNE X1), or directly into a modern asynchronous USB device (TEAC UD-501). Since it is these analogue waveforms that get transduced to sound waves, it's not a stretch to conclude that USB cables make no audible difference. My subjective evaluation of USB cables is consistent with the measured results - no audible differences in controlled tests (my own blind tests).

These days, we all use USB cables of different lengths and varieties for high-speed devices like hard drives and generally either it works or it doesn't. USB protocol sends data in packets which consists of not just the audio data itself (up to 1024 bytes at a time for high speed mode), but CRC check to detect errors, flow control, and also address information to direct the data to the appropriate device (remember, you can attach up to 127 devices to each host controller).  The low-level details of this communication including timing are addressed by the hardware and generally outside of the purview of the software we install on the computer. Logically this means that fine timing issues (like data flow control and scheduling of the data packet delivery) would be outside of the effect of things like audio player software. Furthermore, with modern DACs, the machine will use its own internal memory buffer and very fine timing (like pico- and nanosecond jitter) will be derived from the accuracy of this internal clock.

USB data transfer rate for audio is much less demanding than something like a hard drive. Whereas we can easily transfer >200Mbit/sec to the hard drive using a simple generic USB2 cable, sending standard 16/44 stereo audio to a DAC is only ~1.5Mb/s, 24/96 only needs  ~4.6Mb/s, and 24/192 ~9.2Mb/s. If we go all out with the TEAC UD-501 DAC with DSD128 or 32/384, even that "only" takes up to ~25Mb/sec.

Not unexpectedly, some message forums got a bit heated when the USB cable test post was published since obviously the results deviated from expectations or experiences of subjective evaluation or maybe the person is trying to sell something related. I have seen no good evidence from controlled tests demonstrating otherwise.

Shortly after that post, this set of measurements came out from one of the principles of Empirical Audio (I thought he promised to measure the AudioQuest Diamond USB cable?). Nice to see he measured the down-to-earth Belkin Gold anyhow. I will let you, fine readers, examine the data and determine if you think this correlates with audio quality, or just demonstrating minute differences between lengths of copper with little correlation to digital data transfer much less the analogue output from a DAC! (Note that he's measuring 5m [~16.5 feet] lengths of USB cable to get those picosecond numbers.)

For this installment of MUSINGS, I wanted to have a look at a recent article from the July 2013 issue of Hi-Fi News where they did a "Group Test" looking at USB cables. Since I do not subscribe to this magazine, I want to thank "Mushroom_3" and "Julf" off the Slim Devices/Squeezebox forum for bringing up this article.


As you can see on the cover - "USB cable sound - Fact or fantasy? p43" was advertised. So from page 43-51 (with 2 pages of ads), they tested 10 cables.

Here's the first 2 paragraphs of the article (as usual, I reproduce only small portions out of fair use for the purpose of discussion, education, and critique):

That's a pretty gross generalization and assumption to start off with isn't it? The only thing I think "every seasoned audiophile" knows is that without cables, there can be no sound - and that's assuming your system isn't a boombox :-). That's about the extent of discussion as to whether USB cable sound could be "fantasy" (I think the better word would be 'inaudible'). From there on, it's all about oscilloscope measurements (they give data risetime measurements for the cables and use this and the eye pattern as their objective data), and minimal detail was provided as to how they conducted the "blind" subjective test - we do not know how many subjects participated, how they were selected, in what way was the 'blinding' accomplished, duration between cable swaps, etc. Furthermore, we do not know how the participants scored the cables or what the statistical outcome is - it may be just a "blind" solicitation of subjective opinions on those 10 cables (a huge number to test properly!).

I appreciate that at least Paul Miller the editor spent a page talking about the technical bits of USB cabling on page 98. At least the physical cabling characteristics were described in detail but strangely nothing on the packetized nature or how they would correlate audible differences in such a system of data transfer since IMO this would be much more educational.

The comments below will hopefully make sense to those who have not read the article.

1. From what they wrote, the test setup went like this:
         Laptop --> Test USB Cable --> Musical Fidelity M1 S-DAC --> coaxial cable --> Devialet D-Premier --> speakers
Why was the decision made to use the Musical Fidelity M1 S-DAC as a USB-to-S/PDIF converter? Seriously, you're testing USB cables but introducing a coaxial S/PDIF interface into the middle of the signal path for no clear reason when the M1 is already a fine DAC?! We know that a good USB asynchronous interface has lower jitter in general than most S/PDIF, so why not use the analogue output of the M1 directly to a preamp/amp? I would not be surprised if the Musical Fidelity is a better DAC technically than the Devialet (see below). There was no mention of what coaxial cable was used - surely this must be important since this is the digital cable directly connected to the DAC and these guys believe S/PDIF cables make a difference as per the first paragraph quoted above. How is it possible to test USB digital cables if there's potentially an even more jittery (yes, the dreaded jitter bogeyman yet again) digital coaxial cable/interface in the audio chain?

2. Why was the Devialet D-Premier used? I suspect why they used the USB-to-S/PDIF interface is because the Devialet internally resamples analogue to digital as per the discussion in the Stereophile review, plus it doesn't have a USB interface. Furthermore, the measurements for the D-Premier isn't all that remarkable as a DAC. It achieves a respectable 18-bit dynamic range (remember, the SB Touch already can do 17.5 bits) but like John Atkinson say - it's "not quite up to the standard set by the best-measuring standalone processors, such as the Bricasti M1, MSB Diamond DAC IV, NAD M51, or Weiss DAC202". I don't know about the M1 S-DAC specifically, but the Musical Fidelity M1 appears to outperform the D-Premier already (Stereophile data) and "offers performance that is close to the state of the art."

3. Why was the "grotty giveaway USB cable" measured on p.98 not part of the blind listening test? I wish they included a picture of this "grotty giveaway" - what makes it "grotty" anyways? Why not also tell us what that cable's data risetime is while you're at it? Doesn't this often seem like the case with these audiophile "shootouts"? They have all these high priced options (well, at least they included a £18 QED Performance Graphite) but neglect to include the real competition - something that is essentially free and works!  Another idea - how about testing a reasonable quality "non-audiophile" USB cable like the Belkin Gold for <£5?

4. USB data risetime & eye pattern: is it even relevant to the analogue waveform coming out of the DAC? Are they measuring something which actually COULD have sonic impact? In terms of this article with the risetime derived from the eye pattern as the prime objective measure, what evidence do we have that this actually correlates with the subjective impression? So what if the £18 QED scores 12.8ns, £60 Kimber B BUS Cu scored 12.4ns, £139 Audioquest Carbon scored 11.9ns (hey folks where's the Diamond?), and the insanely priced £6,500 Crystal Absolute Dream scored 11.0ns? What does this risetime have to do with the final DAC analogue output anyways given the nature of packet digital transmission, asynchronous protocol, and a cable that can provide much more bandwidth than required for audio - especially since you're passing the bits off through a digital S/PDIF coaxial in the audio chain?! I question if taking "a good few months" (p.98) to develop this test was time well spent!

5. Why does there appear to be so little correlation between sample rate and audio quality through the USB cables? Surely, a poor USB cable with "slow" risetime should sound worse with 24/96 or higher bitrate music, right? Yet the majority of the subjective complaints focused on 'Hotel California' off Hell Freezes Over CD or Oscar Peterson's We Get Requests FIM K2 CD. Heck, even The Beatles' Abbey Road 24/44 barely taxes the USB interface. The only really "hi-res" track was the 24/192 Helge Lien Trio Natsukashi which was mentioned 3 times total in the whole subjective write-up. Surely, to get a sense of how well USB cables work, we need to grab some DXD and DSD128 material, right? If timing/jitter were that important, there could be big issues with DSD sampled in the MHz range, don't you think?*

6. In the subjective analysis conclusion, you see the following comments: the QED is described as "almost sounds louder", Transparent Performance's cable had "rich and warm sound proving a little too luxuriant at times", Wireworld's Starlight 7 had the "woomph of air that would normally accompany the deepest bass was subjectively filtered away", or the Crystal Cable's "greater extension" - why not measure those things? Surely you can easily detect amplitude changes, differences to frequency extension, tonal changes to add "warmth" in the DAC output, right? Yet, for the objective test all we get is a risetime measurement of a piece of wire and the subjective testing done through a second digital interface of unclear quality and unclear blind testing protocol. Therefore neither the subjective or objective results appear all that convincing.

Assuming we do acknowledge this article as having validity and not just an example of a majorly flawed study (needless to say, the setup using a digital coaxial cable is a BIG problem IMO), there is one thing we learned in this piece for sure that could be of value and a good reminder. Don't buy the £70 Vertere Pulse D-Fi USB cable - apparently it's constructed out of "twin coaxial cables" (err, impedance matching anyone?), has bad rise time (27.6ns), and sounds questionable with "softening of its extreme treble and loss of atmosphere". I wonder if connecting this cable to a hard drive might show slower transfer speed due to high data error rate. Evidence that you can spend more and get significantly less quality than the 'freebie'?

Assuming we don't believe the listening tests are valid because of the methodological issues, then perhaps this article serves as an example of the unreliability of subjective listening. Isn't it possible they're all just listening to the same sound with the "jittery" coaxial digital cable and interface and coming up with different impressions? Since we have no concrete idea of how the "blind test" was conducted (especially what level of statistical confidence we can expect), it's quite possible the term 'fantasy' would be appropriate to describe the results (but verboten).

Enjoy the music folks... IMO, there is still no good evidence that USB cables make a difference to sound (well, at least with decent modern gear!).

My musical selection tonight: C.C. Colletti Bring It On Home (HDTracks 24/96 Binaural recording). Wonderfully spatial sonics and details from the ASUS Essence One + Sennheiser HD800! Have a listen to that title track.


* For the record, I do not believe there is any reason to think DSD would be affected by USB cable jitter to an audible degree with good modern DACs. Just wanted to throw out a thought which the jitter-fearing-audiophile might bring up one day.

13 comments:

  1. Way too much objectivity...again thanks for all your efforts for the demystification exercise.

    ReplyDelete
    Replies
    1. Thanks for the comment.

      "Way too much objectivity" - Well, that's just subjective ain't it :-)

      But seriously, that's the beauty of blogs. You get a sense of the idiosyncrasies and views of the respective authors. IMO, although I can respect the opinions and beliefs of subjective reviewers especially with regards to "look and feel", I've rarely in the last few years found subjective audio impressions all that useful. To me, reasonable objective analysis helps me *understand* the stuff, and that's something I've always valued more in life (not just audio).

      Delete
  2. Good article and amazing blog, as a reader I hope you don't "kill" this blog like so many bloggers do. It's a source of good objective articles.
    Best wishes.

    ReplyDelete
    Replies
    1. Thanks for the note JT.

      Yes, I do intend to keep this blog up for reference. One of the thoughts I had when starting this was to have a source for discussions with friends around audio stuff; especially around some of the beliefs folks may have and what an objective take on it demonstrates.

      Delete
  3. I haven't read the article nor do I intend to as to me (and my ears and far below par gears) the whole cable issue is irrelevant.

    regarding the remarks:
    1: Not mentioning the coax cable seems to be something they 'missed' out and seems a valid remark.
    The reason seems clear; USB to coax conversion with the MF which seems to be in high regard by the authors.

    2: because of it's pricepoint (12.000 MUST sound good) and the fact it is a powerful one box solution (it drives speakers directly which MF can't). The authors hold it in high sonic regards I assume. This all in one solution eliminates the need for audio interlinks.

    4: I don't think audiophiles dispute the data and samples wiould be different via cables, I think they know the data and bits that arrive the same, they just question timing (jitter). I do believe most of them 'think' USB is very 'analog alike' and simply sends continuous streams of 16 or 24 bit data. This causes them to think analog 'assets' can be applied as there is an analog waveform present (a voltage varying over time). They possibly do not understand the mechanisms involved with USB data transfer.

    In 'bad quality' DAC's jitter on the USB bus (which IS present) can be measured on the output IF large enough. Newer DAC's do NOT have this problem. Different types of jitter exist and some of them ARE related to risetime, bandwidth of the cable itself (eye-pattern) so can understand the reasoning behind it. I mean risetime AND eye-pattern being important for CERTAIN older DAC's that 'recover' the clock from the actual USB clock which subsequently is used to clock out the samples of the DAC chip.
    As you already mentioned modern DAC's all have nifty circuits in there that eliminate that jitter and thus the USB jitter problem is not relevant.
    What's still relevant with USB audio (and cables don't matter here) MIGHT be common mode garbage entering the audio chain but that's another topic and needs to be addressed in the power supply(ies) area.

    The strange part remains WHY subjective reports always seem to differ from measurements.
    The reasons for that I already touched in my reply here: http://archimago.blogspot.nl/2013/06/measurements-part-ii-bit-perfect.html

    keep up the good work...
    Secretly I hope in the future some technical minded subjectivist will connect the dots (link the 2 disciplines) that seem to divide the worlds. Honestly I reckon this won't happen as the link does not exist.

    ReplyDelete
    Replies
    1. "Secretly I hope in the future some technical minded subjectivist will connect the dots (link the 2 disciplines) that seem to divide the worlds. Honestly I reckon this won't happen as the link does not exist."

      Secretly, I suspect some folks who write subjective review material already know that what they're writing is in fact false :-).

      Delete
  4. Just stumbled upon your site, and from the initial read have already learned much! I especially appreciate that you go deeper into the technical details of the protocol to describe the bandwidth of the USB and how it translates into requirements of higher bitrates. I'm still somewhat of a novice to the full on audiophile setup, and although I've invested in AudioQuest King Cobra interconnects between my DAC and Amp (both Cambridge Audio 851A/C), I can't convince myseful on spending money on an extended USB cable (from laptop to DAC). Your article clarifies a lot more, and now I plan on checking out the Bitperfect software pieces. Thanks again!

    ReplyDelete
  5. One of the thoughts I had when starting this was to have a source for discussions with friends around audio stuff; especially around some of the beliefs folks may have and what an objective take on it demonstrates.

    ReplyDelete
  6. hope you never stop! This is one of the best blogs Ive ever read. You've got some mad skill here, man. I just hope that you don't lose your style because you're definitely one of the coolest bloggers out there. Please keep it up because the internet needs someone like you spreading the word. Wiring Cables Dealers in Pune

    ReplyDelete
  7. Yes it's true in the market lot's of the data recovery software are available but the selection of the best software is really very difficult task and about the company I know that can help you in recovering your data easily.
    Source:Read More

    ReplyDelete
  8. Loving your posts. Only came across them today, and although I'm fairly sure that in the past, my ears have fooled me into thinking digital coaxial cables sounded different, perhaps thats more the fault of a rather antiquated DAC by modern standards. I've yet to be convinced that any differences exist in USB cables. Most particularly because I work in IT for a living, and deal with enterprise level networking and data storage every day. The concept of a USB cable failing to get all the data from one end to the next is almost laughably ludicrous.

    Your tests here have only served to enhance my happiness at using the USB A to B cable that came with my last Dell Monitor. It seems to do a perfectly find job. For context, my system is a Mac Mini, connected via Asynchronous USB to a TEAC UD-H01. A combination that provides excellent sound far in excess of its total cost to me (around £300 total).

    If someone could have told me even 5 years ago that I could have 24/192 audio, bit perfect, from a system that allows me to use an ipad as a remote control, and that it would cost me £300, I'd have thought they were high. Having since back to back demo'd my little TEAC against DAC's in the four figure range, it seems to give nothing away, leaving me to believe that in 2013, digital has pretty much come of age and spending more doesnt necessarily get you any more performance.

    Keep up the good work

    ReplyDelete
  9. This is such a great resource that you are providing and you give it away for free. I love seeing websites that understand the value of providing a quality resource for free.

    High Voltage Testing

    ReplyDelete