iTunes 7.3 Sorting Problems: Fallout Central

Part of the iTunes Sorting Debacle Series

  1. iTunes 7.4.2: No Change in Sorting behavior
  2. iTunes 7.3 Sorting Problems: Fallout Central
  3. iTunes’ totally effed up sorting

Apple has really screwed up with the new sorting behaviors introduced in iTunes 7.3 and it’s making a lot of people seriously unhappy. And, honestly, I’ve NEVER been mad at Apple for anything in my 25+ years of history with the company (annoyed at times, but never mad), but the more I think about this the more pissed I get. For those just joining the story, Apple released version 7.3 to accompany the launch of the iPhone. Included in that release was a new, completely arbitrary rule set for sorting Artist, Album, Composer, Genre, etc tags.

Quoting myself:

Starting with version 7.3, numbers and other non-alphabetic characters are sorted to the bottom of the list. My default view now shows Aalborg Symphony Orchestra at the top. 2pac now begins after the Zs and iTunes suddenly doesn’t even know how to handle artists whose names begin with punctuation. It starts !!! after songs that don’t have anything entered into their Artist or Album tags!

*snip*

iTunes now ignores the non-alphabetic leading characters and sorts based on the first letter or number it finds in the name. The program now treats fields that are all punctuation as if they are blank, as if they have nothing typed in at all. And guess what else? It passes that behavior to the iPod.

At first, it seemed that the issue was a bug, but as revisions came out, it became clear that this new behavior was intentional. Indeed, an Apple support document created July 11, 2007, explains the new scheme as if everything is hunky-dory. The odd thing about this is that there is no rational explanation for it. Before 7.3, iTunes used case-insensitive ACSII as its basis. It’s a decades old standard that all electronic devices use.

Symbols > Numbers > Letters. That’s the order the entire Western world has been using for all of modern memory. Look on any computer’s desktop and that’s how you’ll see files arranged. Hell, even the 131-years-old Dewey Decimal System sorts numbers before letters. Perhaps more bizarrely though, is that this behavior only appears to affect the first character in the music tags. Playlists and second character sorting (unless the whole field is made of punctuation) still seem to use the ASCII method. Say whaa? If you’re going to screw up a standard, you might as well be consistent with your screwery.

Seriously, this abrupt abandoning of established convention brings Apple closer to Microsoft’s behavior regarding standards. Could you imagine if, on a whim, Apple suddenly changed the way Safari renders web pages to its own specifications, rather than W3C standards, perhaps in order to accommodate the iPhone? That’s how bad this is.

So far, the suggested workaround is to use the Apply Sort Field command to manually restore normal sorting, a process that is cumbersome, tedious, counter-intuitive and shouldn’t even be necessary. In my case, I’d have to apply it to 150-200 albums and gobs of composers and I’m not about to waste my time doing so. Alternately, you can downgrade to iTunes 7.2.

I am not alone in my ire. Others in the passionate-about-iTunes community are equally upset at this development. Here’s some choice reactions from several threads around the net.

Code Monkey at iLounge forums:

It’s not just a “strange” decision, but a downright moronic one. First off, anybody bright enough to use a computer knows that symbols and numbers sort before alphabetical characters. Second off, what was the whole point of introducing the ability to customize sorting in 7.2 if they were just going to turn around and bork it with 7.3?

GadgetGuru72 on the Apple Discussion boards:

Thanks. I am familiar with all the suggested workarounds.

However, I shouldn’t have to use a “workaround” to get a “1” or a “?” to sort before the letter “a” any more than I should have to use a “workaround” to get the letter “a” to sort before the letter “b.”

Amen to that.

Andrew Wiggins in the comments to another iLounge article:

I’m extremely irritated that the numbers vs. letters order has changed. This has messed up with my established order for albums that I was very pleased with.

Comment at engadget: (sic)

WHAT ON EARTH, HOW ANNOYING

they have changed the Digit order, when you sort column be accending, so all those people who had there music sorted by Artist with bands like +44, 65 Days of Static and 30 seconds to Mars ect… will now find that in that mode they are liseted at the bottom after your XY and Z’s (if you have any) Thats just annoying, why the change?

The rampaging horde at Digg:

The sorting in iTunes 7.3 is totaly screwed. Apparently numbers now come after letters.

This was by far the most annoying thing in the update. Brackets and parentheses are ignored in sorting, too!

WTF are they thinking?

well, I did notice that the sorting on the iPod is the same way. Numbers come after letters.

In any case, stupid.

The numbers after letters thing is what really gets me. It’s completely f’ed my entire library.

Comment at Neowin forums:

I really dislike what they did to the artist ordering. That alone makes me want to downgrade

Comment at MacRumors forums:

The 7.3 update is what caused the error in sorting (numbers and symbols after z.) I was hoping the 7.3.1 update would fix it, but it sounds like it doesn’t.

Quote:
Originally Posted by ryry919 View Post
not sure if anyone else has noticed this, but when I opened iTunes back up after the update I noticed that all of my artists that are a # (IE: 311, 3 Doors Down) are all now at the end of the iTunes artist sort rather than being at the top, before the A’s like it used to be.

anyone know of a way to change this back? is there anything like how you can either view you contacts in address book for first, last or last, first? just wondering.

I downgraded my iTunes to 7.2 for the time being.

Someone’s LiveJournal

Dear $deity why? Why would they do that?

Everybody knows its punctuation->[0-9]->[Aa-Zz], anything else is heresy!

And so on. I’ll add more as I run across them.

For now, the only way to get “standards compliant” sorting back is to downgrade to iTunes 7.2. I’ve done this already and until I see a version that restores standard procedure (or at the very least offers the option of using either scheme), I will not be upgrading to any future version of the software. That basically means I’ll never buy an iPhone or any other product that requires a subsequent version of iTunes. I’ll probably save myself some money that way. If you don’t have an iPhone, I suggest that you do the same. Download for Mac. Download for Windows.

In the meantime, though Apple’s traditionally not very responsive to customer feature complaints, it never hurts to try: http://www.apple.com/feedback/itunesapp.html

Yeah, What They Said 8/25

Links to interesting stories. This edition is long overdue.

Medialoper: 5 Ways to Improve eMusic
I love eMusic. At ~$0.25 per song, it’s easily one of the best values in the digital download arena. While generally functional, parts of the site could use some overhauling. Medialoper leads the discussion on how.

Cognitive Daily: Even the musically untrained respond differently to new symphonic movements
“A new study of brain responses to music has found a striking difference in brain activity when a symphonic movement ends and the next one begins, compared to other parts of the musical work.”

Fredflare: Rad Chat with Ratatat
Fredflare talks it up with Evan Mast of Ratatat, one of the greatest bands of the current millennium. Amongst other things, he explains the origin of the band’s name:

The band was originally called Cherry, but there was conflict with other bands using the same name so we had to change it. We just sat down and brainstormed for a few days. It was slow going, but then the name just popped into my head and it was the first idea we’d had that we didn’t absolutely hate. After a while we even started to LIKE it. Now I really like the name Ratatat and I don’t like Cherry much anymore. Cherry” made us sound like sissies! “Ratatat” makes us sound tough, right?

Hollywood Reporter: Unique stories lie behind every licensing deal
A series of anecdotes about the various licensing deals a number of artists have entered into and the effect those deals have had on their careers.

A lot of people claim that they can’t hear the difference between a 128kbps file and a 256kbps file. This video proves that there is indeed a difference.

I think every English speaking person in the world should read this story all the way to the end. It’s a life-changing experience. After you’ve finished, you’ll probably want to die, or kill, or both.

Have a non-iPhone phone or PDA with audio capabilities? Out-of-the-box, iTunes doesn’t offer much in the way of getting audio files onto them. SyncTunes however, might be your savior.

::

And finally, a RatingQuest update: As of 8/25 6:30PM EDT, I have rated 8,050 out of the 15,865 songs in my iTunes library. That’s 50.7% completion, a 2.6% increase from when I started.

iTunes’ totally effed up sorting

Part of the iTunes Sorting Debacle Series

  1. iTunes 7.4.2: No Change in Sorting behavior
  2. iTunes 7.3 Sorting Problems: Fallout Central
  3. iTunes’ totally effed up sorting

…and managed to sully my iPod too. And the more I think about it, the more pissed off I get. What Apple has done defies all standard convention, is completely arbitrary and makes ab-so-lute-ly zero sense whatsoever.

Allow me to go on.

I had put off updating my iTunes to 7.3.2 until a couple days ago. With all the time and energy I invest into pruning and perfecting my library (it’s like bonsai really), I usually give the early adopters in the Mac community enough time to warn me of any critical errors or whether the new update is going to irreparably damage or otherwise soil my files. It’s just common sense.

So, having read no reports of exploding iPods or iTunes-induced electrocutions, I figured it was time for the latest and greatest. At the very least, I could get the app to stop bugging me about the update every time I launched it.

The update process went smoothly enough, like a Dove chocolate bar, and I was quickly back to makin’ playlists and retrieving album art. It took me about a day, however, to realize something was… awry.

The default view of the Music tab had changed. As a matter of course, I keep it set to Album by Year, which in effect sorts by artist then sub-sorts the albums by the year they were released. Before the latest update, that meant that the band !!! was listed first, followed by +/- then into the numbers. It was logical: standard convention dictates that that’s the way alphanumerical sorting is done in English.

Far be it for Apple to let any convention go unchallenged…


neatly organized ipod composers
Neatly organized iPod composers.

scrambled ipod composers
A scrambled mess.

Starting with version 7.3, numbers and other non-alphabetic characters are sorted to the bottom of the list. My default view now shows Aalborg Symphony Orchestra at the top. 2pac now begins after the Zs and iTunes suddenly doesn’t even know how to handle artists whose names begin with punctuation. It starts !!! after songs that don’t have anything entered into their Artist or Album tags!

On one hand though, I do have to give iTunes some credit. When sorting numbers, the program is smart enough to know that, numerically, 101 Strings comes after 50 Cent.

I’m not averse to change in general, and though somewhat inconvenient, these new sorting behaviors aren’t a fundamental flaw. I can deal with it. Update 8/28: I take that back. This IS a fundamental flaw and it needs to be fixed. There’s no excusing it. However, the real travesty here is how iTunes now treats the Composer tag. In this case, it looks like Apple specifically set out to destroy my Composer tag scheme, the one where cover songs have the original artist surrounded by [brackets]. The purpose of that is to separate cover tunes from actual composers when browsing Composers on the iPod.

Well, guess what? iTunes now ignores the non-alphabetic leading characters and sorts based on the first letter or number it finds in the name. And guess what else? The program now treats fields that are all punctuation as if they are blank, as if they don’t have any characters at all. It passes that behavior to the iPod. Now when browsing by Composers, the list I’m presented with is a jumbled mess. I’ve got [Fleetwood Mac] sittin’ next to Edvard Greig and [Ted Nugent] holding hands with Tchaikovsky, which is the exact situation I was trying to avoid in the first place!

And that’s not even mentioning my workaround for remix albums, where I list the song’s originator in (parentheses).

So, thanks Apple for fixing something that wasn’t broken.

So, the 5G iPod has a problem with Audiobooks…

Not all audiobooks, mind you, just homemade ones; downloads from the iTunes Store and Audible seem to work fine. The story goes like this…

My carpool ended a couple weeks ago, as my riding buddy resigned to take another job. I’m going to miss the amity, conversation and, of course, the gas and mileage savings, but my solo commute will now give me the opportunity to invest more time into audiobooks and other spoken audio, passing the dreadful Atlanta Interstates somewhat more productively. I’ve started with Foucault’s Pendulum by Umberto Eco. It’s a fascinating adventure story about literature, philosophy, old secrets and the legacy of the Knights Templar told with compelling intellectual prose.

I first read the book eleven years ago when I was in high school and it inspired my to write a paper on the Templars, which brought me into contact with a strange world of the paranoid and the occult. Since then, I’ve noticed in modern books and movies, how mythical versions of the Templars, like Atlantis, are often brought up as keepers of ancient secrets, power and wealth that even today’s advanced civilization can’t understand.

Plus, a good portion of the book takes place in Paris, where I happened to be at the time I was reading it. At one point, I finished a paragraph and decided to immediately visit the location that had been described. That was pretty cool. However, unbeknownst to me at the time, between the publishing of the book in 1988 and my visit in 1996, the actual Foucault’s Pendulum was moved from the Conservatoire National des Arts et Métiers to the Panthéon, so I never did get to see it.

That’s great and all, but what does it have to do with the iPod?

Well, having decided to re-read/listen to the book, I promptly stitched together the nineteen audio parts into a bookmarkable AAC (m4b), which iTunes and the iPod treat as an audiobook. I started listening to it on the ride to work, getting about 30 minutes into the story. Once at the office, I switched to music, then when the day was over, switched back to the book for the ride home.

As expected, the book picked up where it had left off, continuing the story. All was well for about a minute, then the book suddenly stopped, returning to the iPod’s main menu. When I restarted the book, it began playing from the beginning, having lost the bookmark. Annoying to say the least. I noticed the next I synced up that the file’s play count had increased by one, as though the iPod thought it had played to the end.

This was not the first time this had happened; I had previously encountered this problem with a bookmarkable AAC audiobook of Al Gore’s The Assault on Reason, but at the time, I chalked it up to an error in the file. But this second occurrence indicated that something else might have been afoot. The behavior occurs anytime a homemade M4B file is interrupted, whether by playing another song/podcast/audiobook/video, syncing the iPod with iTunes, or if the iPod is asleep for long enough that it turns itself off and requires a reboot. The problem doesn’t occur if the audiobook is simply paused and restarted.

So I set about trying to find a solution to this irksome problem.

A quick trip to Google turned up a thread on the forums at Audiobook Builder’s website. Audiobook Builder stitches together many files to create (build), you guessed it, one long audiobook, which is great for books spread across multiple CDs. ABB happened to be the program I used to create my Pendulum M4B file, so it looked like a good place to start (though I’m not implying that Audiobook Builder was at fault; my Assault on Reason files were similarly deficient and those were stitched together with the Join Together AppleScript).

The direction of that discussion leaned toward the mix of the file, specifically if it were mono, was the culprit. Sure enough my files had been encoded as mono. (Quick aside: Files encoded in mono aren’t any smaller than a stereo counterpart at the same bitrate. However, you can use a lower bitrate and maintain the quality of the sound with mono). Thinking I had the case solved, I converted the files to stereo, synced up the iPod and continued with the story.

For about a minute.

The thing quit again. Clearly the channels were not the issue. Without any further leads, I set about trying to eliminate variables. I tried a higher bitrate. I tried a lower bitrate. I removed the album art/book cover. I took all the chapter markers out. I removed all ID3 tags until all that was left was a bare bones AAC file. Then, just when it looked like that might work, it failed again.

The last recourse was to segment the file into shorter pieces. Rather than one 24 hour file, I have ten 2-2.5 hour files. Yeah, that’s fewer than the nineteen files I started with, but it’s not as elegant as a single long one. But it works, so despite my frustration that the bug exists, I can finish my story without the constant scrubbing to a lost place mark.

I love my iPod, but *sigh*

::

PS

Another workaround I thought of is to use join the pieces into one long MP3 file. Then, after adding it to the iTunes Library, get info on it, marvel at the incredible length of the file, and select “Remember Playback Position” in the Options panel. That will emulate the bookmarking feature, but you won’t be able to play it slower of faster like a bona fide M4B Audiobook.

I’m quoted on the Star Wars wiki…

The other day, I was perusing the ol’ server logs, doing my periodic behind-the-scenes examination of this site. Mostly it was the usual stuff: popular URLs, a couple image hot-linkers and an ungodly amount of Googlebot crawls. But then something caught my eye: a new and intriguing referring site.

http://starwars.wikia.com/wiki/Shadows_of_the_Empire_(soundtrack)

I checked it out, trying to find the connection to here, and discovered a lengthy and detailed encyclopedia article on the orchestral score to the Star Wars derived Shadows of the Empire project. Turns out the wikians behind it picked up part of a post that I wrote about it last year, during the actual tunequest.

Here’s me quoting the Star Wars Wiki quoting me:

Tunequest remarked that the highlight of the score was “The Seduction of Princess Leia,” saying that the piece is “built around a fabulous freakin’ waltz, a first for Star Wars.”

So yay for the slight ego boost.

It’s especially gratifying to see my work included with other prominent film score sites such as Filmtracks and Soundtracks.net. It does seem, however, that some of the factual assertions I made about the score may be in error. On that point, I must defer to the wiki, for it relies on quoted and referenced sources, whereas my own claims were based on the rickety and fragile strands of memory.

Still, the article holds up. Check it out. And if you’re into that sort of thing, explore the Star Wars Wiki (Wookieepedia); it’s crammed full of Star-Warsiness.

Keyboard Shortcuts for AppleScripts: An iTunes Power Tip for Mac Users

Note: The behaviors described below are from Mac OS X 10.4.10. Previous versions of the OS might not behave as described. YMMV.

Keyboard shortcuts are the life-blood of the power user. Casual users know of the basic ones: Command-Q to quit, Command-W to close a window, Command-F to find, etc, but the power users have them all memorized for every program they use. For them, actions that would take 3-5 seconds of arduous mouse work can be accomplished in as little as half a second of keyboarding. That’s up to a 10x increase in productivity! Heck, many individuals, myself included, can go for minutes without even touching the mouse.

But even the most vaunted power user might not know this trick.

Mac OS X (both Panther and Tiger) has a little-promoted feature that lets you customize some of those keyboard shortcuts for menu items. Even some global commands can be changed to suit your tastes. Don’t like Command-P to Print? Change it. You can even make it an F-Key and return some functionality to your keyboard’s top row. In some cases, you can give shortcuts to menu items that don’t have one.

There are some caveats however:

  • When entering your new keyboard shortcut, you must make sure you type the Menu Item exactly as it appears in the Menu. Same spelling, capitalization and punctuation. Many menu commands end with an ellipsis, which you can type by pressing Option-; (semi-colon).
  • Also, if you choose a key combo that already exists, in most cases, the new one will replace the old one, leaving the original without a shortcut. Some programs will assign the duplicate shortcut, but it just won’t work.
  • Finally, there are apps that will not be affected by the changes you make. Photoshop, for one, uses its own internal shortcut customization scheme and won’t recognize anything you change in System Preferences.

So, having said all that, let’s apply it to iTunes.

The Macintosh version of iTunes, as you may well know, can extend its capabilities via AppleScripts, those little bundles of code that help with repetitive tasks, make organizing easier and add new features. A new Scripts Menu will appear in the Menu Bar when AppleScripts are installed script menu. If you’re reading an article on how to add a keyboard shortcut to them, you probably already know this. The beauty is that the system treats the Scripts Menu just like any other and you can add a keyboard shortcut to any script you have installed.

Identify Scripts

The Scripts Menu before

Start by opening iTunes. Click on the Scripts Menu and determine which scripts you want to add shortcuts to. Note their names as they appear in the drop-down. For this example, I’m selecting a Script called Embed Artwork. It copies album art downloaded from the iTunes Store into the individual music files; iTunes doesn’t do that by default, so I end up using it pretty frequently. I’ll also do Quick Convert, since I often use it to convert podcasts into audiobooks for faster listening.

Apply the Shortcuts

adding keyboard shortcuts to itunes

Open System Preferences. Select Keyboard & Mouse, then Keyboard Shortcuts. Click the + (plus) sign in the lower left, then select iTunes from the Applications pop-up. In the Menu Title field, enter the name of the script. In the Keyboard Shortcut field, press the key combo you wish to use. For Embed Artwork, I’m choosing Command-F1, Quick Convert gets Command-F2. A modifier key is required in iTunes. Stand-alone F-Keys, for whatever reason, will show up in the menu but they won’t do anything when pressed. When you’re satisfied, press Add to save.

Relaunch iTunes

The Scripts Menu after editing keyboard shortcuts

iTunes loads the keyboard shortcuts when it is launched, so quit and reopen it. When you click the Scripts Menu, you’ll see your new shortcuts displayed next to your script titles.

It is important to remember that configuring keyboard shortcuts, in general, is an inexact process. If something doesn’t work, find an alternative. I know I would love to use those F-Keys in iTunes. but for now, I’ll have to settle for the workaround. Still, these added functions will be a boon to anyone’s productivity.

Ratatat – Loud Pipes single: Another smooth creation

ratatat loud pipes

I don’t know how I missed it, but Ratatat quietly released Loud Pipes as the third single from Classics a couple months ago. The record is out on vinyl only and, in addition to the title track, it features three attractive and compelling b-sides:

  • Loud Pipes (Outtakes).
    Bears only the slightest resemblance to its namesake. The beat and instrumentation are there, but otherwise, it’s a whole other song.
  • Kennedy (e-rock remix).
    E-rock is Ratatater Evan Mast’s brother. He turns in a competent re-working of Kennedy (also from Classics). His version sounds a little repetitive, but it has got some big sound behind it. There’s also a nifty breakdown around the 5:20 mark.
  • Goose.
    New track. Rhymes with Noose, the b-side from Germany to Germany. The song is the least-stated in all of Ratatat’s repertoire. In stark contrast to the band’s enormous sound, Goose is barely there. A simple baroque-esque melody over a quiet, high BPM thud-thud-thud. At less than two minutes long, the song is over before it gets started.

All in all, another fine release from Ratatat. Now when can we expect that next album?

Loud Pipes: $7.00 from Turntable Lab

Listen to Loud Pipes (Outtakes):
[audio:070807LoudPipesOutakes.mp3]