Press "Enter" to skip to content

Category: computers

Crucial m4 SSD for Data Processing

I’ve been processing some relatively large sets of data at work lately, and I’m running into disk IO issues after kicking off some of the data processing tasks. As an easy way to alleviate this I picked up a 64GB Crucial m4 SSD and stuffed it into my laptop’s optical drive bay via a $20 Nimitz-branded SATA hard drive adapter acquired from eBay. The drive itself was $99.99 from Micro Center, and since I purchased it myself once I’m done working with it I’ll be able to repurpose it in a personal machine of some sort.

While not a panacea nor excuse for my poor habits of bolting together VBScript and GNU command line utilities, it has helped quite a bit. One typical script (immediately post-reboot, with an empty disk cache) takes ~120.234 seconds to run a task from the hard drive and ~28.400 seconds from the SSD. I’ve seen similar speed improvements across the board, and this really helps when I’m prototyping things and wanting feedback as quickly as possible.

Leave a Comment

Vector Symbols for Maps

Ever been drawing a map and found yourself needing vector copies of symbols? Well, thanks to the great state of Minnesota there is a font containing most of these symbols freely available. On the state’s page Recreation Symbols Extension for ArcView one can download recreate.ttf, a 126-character TrueType font containing indicators for everything from XC ski trail difficulty to lighthouse locations and from winter camping sites to RV dump locations.

To make using this font easier I’ve created a spreadsheet-based key listing each of the symbols next to their corresponding Unicode character. This can be found here: Minnesota DNR Recreation Symbol True Type Font Key.xlsx

There’s a few other nifty things that Minnesota has provided to the general GIS community, including Road Symbols. The rest can be found here.

UPDATE: Here is another set of symbols provided by the National Park Service (NPS). These are much more up to date and provided as both PDF and .AI files.

2 Comments

Plastic Bottles, Foil, Visine, and a Shoe

Oh, the things that one finds when looking for a route for some new trail. There were three or four of these, an empty bottle of Visine, and one shoe are all laying within 15′ of each other next to a hiker / game trail leading from some apartments to the main two track. If I’m able to route a trail as hoped then another piece of return trail will pass through this area and make for a small segment ending directly across from the current trail start.

I came across this while looking over a place for a new segment of trail after finishing up some tweaking of the newest segment of trail in the park. There were a few poorly designed corners to sort out, some overhanging brush to trim, and some weirdly rough/lumpy trail surface to smooth. It was a fun 3.5 hours of work on a very nice autumn afternoon. Now, to ride it and see what else needs adjusting.

1 Comment

Why Intuit? Why?

Dear Intuit, why is this option in Quicken 2012 necessary? I would have hoped that a modern application would be able to detect a date change and handle this itself without needing a restart.

UPDATE: Here are two posts that Nick found where Quicken support folks explain the issue away as “…this would have required extensive reworking of Quicken, and possible other bugs while working it all out” and “The “Quicken Restart” process is like a mini reboot of the program, to make sure that all services are properly dated/timed/synchronized.”. Isn’t sorting those things out what the sales of Quicken are supposed to pay for?

I suspect that Quicken reads the date on startup, that gets used a bunch of places, and it’s presumed by most of the app to be static. I imagine this option is because they aren’t interested in doing the heavy lifting to have the date-consuming pieces of the app handle being notified of a date change. Or something. Either way, needing to restart an app just because a date changes smacks of incompetence.

Having been a regular Quicken user for more than ten years now, I’ve noticed that Intuit seems to have little interest in moving the app forward. I wonder if this is because they are hoping to get most people over to mint.com or something and let Quicken die.

Leave a Comment

Keyboard Cleaning Time

A visible build-up of finger gunk on the flat surface and laser-etched numbers on most-used keys shows that it’s time to clean my keyboard. To do this I first use Simple Green All Purpose Cleaner at full strength, then a generic glass cleaner to remove the Simple Green residue, then 99% isopropyl alcohol to remove any remaining residue. Each is applied to a clean paper towel and used to carefully scrub both the keys and gaps between. Being one of the (excellent) modern, flat, metal-body Apple keyboards it’s particularly easy to clean, and after I’m done the keyboard feels like new.

Leave a Comment

Microsoft Excel Date Munging: 1900 vs. 1904 Date System

While working on migrating data for the upcoming MMBA Chapter Transition one of my tasks was to export membership data, split it into chapters, then sent it off to IMBA for import into their membership system. After getting the information out of the database I used my Mac to create one large spreadsheet with all the requisite fields covering the entire state (including a chapter column) and sent it around to all interested parties for confirmation that it looked fine. The next step was to break it out into per-chapter data so this time I sat down at my PC, opened the file, filtered on each chapter, selected everything displayed, copied the data, created a new file, pasted the data, saved the now per-chapter data, and sent it off to IMBA.

A couple weeks later, once the files had been pulled into IMBA’s systems, I received a few notes questioning the data as some chapters listed only single-digit counts of active members whereas they were known to have exponentially more. Checking over my data I found that the per-chapter spreadsheets were wrong, and that the date columns had been decremented by a good deal rendering most active memberships expired. For example, on my personal row the expiration date of 6/29/2012 became 6/28/2008.

After a bit of investigation I learned about the toggle shown above to set Excel documents to use the 1904 Date System, and this turned out to be a big key to figuring out the problem. As documented here in Microsoft KB article 180162, when I’d first created the spreadsheet on Mac the file was set to use the Office for Mac default of 1904 Date System and the populated with the accurate data. Opening the file on PC retained this 1904 setting and displayed the data correctly, but when the new file was created with the PC default the 1900 Date System and data pasted into it became offset by roughly four years. I’d presumed that the copy/pasted data would be the same and with the first few columns in each sheet looking correct I didn’t check the rest, and files with incorrect expiration data were thus sent off to IMBA.

The real reason for this goes a bit deeper and involves how Excel stores dates. Specifically, dates are stored as a numerical offset (called a serial number in Excel) from a starting point in time (an epoch). Toggling between the 1900 Date System and 1904 Date System changes the epoch, but as date fields copied and pasted between sheets are copied as their serial number, if the epoch changes the displayed date will be different. The data behind the scenes doesn’t change, but the information presented to the user does. See Microsoft KB article 180162 for a more detailed explanation of why this occurs.

I understand all of the reasons why this works as it does (legacy compatibility with Mac vs. PC, the use of a serial number + epoch so that all international date formats are easily handled, etc) but in some edge cases (such as what I ran into) the result for the end user is maddening.

Leave a Comment

iTunes 10.4.1 UI Bug

There is a UI bug in iTunes 10.4.1 which causes the rewind (<<) button to become highlighted when switching to the Mini Player. This causes unexpected behavior when one Cmd-Tabs to iTunes and presses space intending to pause the music. To replicate this issue do the following: - Bring the normal iTunes window to the foreground. - Note that the Play / Pause button is highlighted. If it's not, press Tab to move the highlight to it. - Double-click a track to begin it playing. - Click the + or press Shift+Cmd+M to switch to Mini Player. - Note that the rewind (<<) button is now highlighted instead of the Play / Pause button. This was tested with iTunes 10.4.1 on OS X 10.7.1. UPDATE: This appears to finally have been fixed in iTunes 10.5.3.

1 Comment

16GB of RAM in my iMac

Along with the SSD I also upgraded the RAM in my iMac to a full 16GB. It’s amazing to me, but a full 8GB (2x 1333 MHz SO-DIMMs) is only US$59.99 from Crucial. It wasn’t long ago that an 8GB flash card cost this much.

Sure, I don’t need this much RAM very often, but I did find that with 8GB and a bunch of design programs open (such as when doing PCB or mapping work) the machine would occasionally page. At today’s prices I don’t mind buying a bit more ram so that swap is almost never used.

1 Comment

Shell Variables Not Expanding in %PATH% on Windows 7 Non-Administrator Command Prompt

I recently ran into an interesting issue on Windows 7. Users running a non-Administrative Command Prompt on Windows 7 would find that Windows’ programs which are supposed to be in their %PATH% (eg: ipconfig.exe, xcopy.exe, etc) weren’t. Checking the path showed that shell variables inside of the PATH variable weren’t being expanded:

Path=%SystemRoot%\system32;%SystemRoot%;%SystemRoot%\Wbem;%SYSTEMROOT\System32\WindowsPowerShell\v1.0\;C:\Program Files\Microsoft Windows Performance Toolkit\

However, if Command Prompt is run as an Administrator (Start → Right Click Command PromptRun as administrator) %PATH% will be set correctly:

Path=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\Wbem;%SYSTEMROOT\System32\WindowsPowerShell\v1.0\;C:\Program Files\Microsoft Windows Performance Toolkit\

Thanks to a coworker, online research, and the helpful folks over at serverfault the cause of this was found to be an incorrect value type in the registry (discussion here). Specifically, the Path value in HKLM\SYSTEM\CurrentControlSet\Control\Session Manager\Environment must be set to REG_EXPAND_SZ so that it’ll expand shell variables that it contains. If (incorrectly) set to REG_SZ the symptom above will be seen because the variables aren’t expanded.

What doesn’t (yet) make sense to me is why this issue is only visible with the incorrect type in a non-administrative Command Prompt.

For reference, per this MSDN article entitled Registry Value Types the difference between REG_SZ and REG_EXPAND_SZ is that the latter will expand shell variables that it contains; literally “A null-terminated string that contains unexpanded references to environment variables”. The former (REG_SZ) is just a string.

3 Comments

SSD Installation in a Mid-2010 27″ iMac

This weekend I fitted my 27″ iMac with an SSD and I now have that running as the boot and OS drive, with large-stuff-storage on the internal 1TB drive. I’ve been considering an SSD for a while, and with prices finally becoming reasonable (~$225 for 120GB) it was time to give it a go. Due to Apple’s screwup last year I ended up with a mid-2010 iMac; a model which could have been ordered with an SSD from the factory. While this 27″ iMac didn’t come with an SSD, thanks to this post by Tobias Müller I found that it was possible to buy the plastics and cabling and add one with a factory-type fit. So, I did.

After receiving the parts and reading through Tobias’ post and the Apple factory service manual I set about fitting the drive. I won’t go into details of the install here, but it would easily rate 4 out of 5 for difficulty of non-custom computer work that I’ve done. Because the SSD sits in a carrier behind the logic board I had to remove the display, power supply, LCD power supply, Airport card, a blower, hard drive, optical drive, logic board, and an IR receiver to get the job done. The SSD, mounted in the pressure wall / plastic carrier and connected with a new wiring harness, settled nicely into the case and everything went back in.

Beyond the SSD, if you’d like to try this modification yourself you’ll need the following Apple parts:

922-9531: Power Cable / Wiring Harness
922-9485: Pressure Wall
922-9538: SATA Cable

I purchased all of these new from Usedmac for a total of $84.24 shipped and installed them along with a 120GB Intel 320-series SSD. These parts, with the SSD attached, can be seen here. If you don’t want to pay ~$20 for an Apple-specific SATA cable, a 10″ cable with a right angle connector on one end (only) which bends towards the top of the drive will suffice.

4 Comments