Windows Vista and Advanced Format Disks

Update: Microsoft and Intel removed the original pages for the relevant Vista KB patches and RST drivers, so I have uploaded the files locally (both 32-bit and 64-bit versions). For working links – please scroll down to the TL;DR section.

Introduction

Advanced Format hard drives have started rolling up in the past couple of years. Today you are more likely to buy an Advanced Format drive than not.

Generally speaking, an Advanced Format (AF) drive will have 4KB physical sectors, as opposed to 512B physical sectors on a standard/legacy format drive. There are some efficiency advantages to this, which can allow, in the future, higher density and possibly better performance. The technology brief can be read here.

Since many home operating systems and applications have learned to rely on 512B sector sizes, many of them would not support a 4K-drive natively. For this reason, all AF drives currently on the market work in 512B emulation mode – they allow the OS/BIOS/Firmware to access logical 512B sectors, and the drive translates it to physical 4KB access under the hood.

Sounds perfect? Almost. There are two issues:

Unaligned access

Even though the low level deals with 512B blocks, most higher level access is typically in 4KB or larger chunks. If not aligned on a 4KB boundary, this can lead to performance penalties, since one logical block is split across two physical sectors. This is not that hard to deal with – all it takes is that the partition start is aligned on a 4K-boundary, which will make all logical blocks aligned as well. Fortunately, Windows install routines since Vista SP1, as well as most modern cloning/partitioning tools will align the partition just fine (some of them always align, some do when they detect an AF drive or an SSD).

Summary of support for Advanced Format drives in modern operating systems and some partitioning/cloning tools:

Broken Windows Update and other components

This problem is actually much more serious. It appears that although Windows in general works fine with the emulated 512B logical sectors, some key components still rely on the actual physical sector size, and cannot function. Specifically, they often cannot function if the physical sector size changes. But how can it change suddenly? Well, for example, in the following scenario which is not uncommon these days:

You are replacing a failing hard drive or just want to upgrade your drive, without reinstalling the operating system
Your new drive is Advanced Format, whereas the old one was not
You clone your existing OS installation to the new drive or restore from a backup image

What are the possibly affected components? Turns out there are a few, and some of them are quite important. According to Microsoft, these are the components that rely on the ESENT (Extensible Storage Engine), which include:

Windows Update
Active Directory
Windows Desktop Search
Certification authority (CA)
Windows Internet Name Service (WINS)
Dynamic Host Configuration Protocol (DHCP)
Windows Live Mail

Microsoft – The Fix that Won’t Fix

Turns out, Microsoft has actually been aware of the issue for quite some time and there are KnowledgeBase (KB) articles to address it:

Windows Vista / Server 2008:

KB2470478: Applications that are built on ESENT and that run on a Windows Vista-based or Windows Server 2008-based computer may not work correctly after the reported physical sector size of the storage device changes
KB2553708: A hotfix rollup that improves Windows Vista and Windows Server 2008 compatibility with Advanced Format disks

Windows 7 / Server 2008 R2:

KB982018: An update that improves the compatibility of Windows 7 and Windows Server 2008 R2 with Advanced Format Disks is available

Now we’ll finally get to the key topic of this article.

So what is the problem? Well, if you run Win7, chances are you’d have no problem, because the hotfix was pushed as an update an was in fact included in Win7 Service Pack 1. However, for Vista, Microsoft, for whatever reason, decided not to push the hotfix to users. Even if you rigorously download all important and recommended updates, you would not get either of the two hotfixes mentioned above. If you read the KB articles, you will read the following:

A supported hotfix is available from Microsoft. However, this hotfix is intended to correct only the problem that is described in this article. Apply this hotfix only to systems that are experiencing the problem described in this article. This hotfix might receive additional testing. Therefore, if you are not severely affected by this problem, we recommend that you wait for the next software update that contains this hotfix.

But the hotfix was released post Vista SP2, and no “software update” with it ever came.

So, if you happened to be running Vista and cloned your installation to an AF drive, you would be facing the following unpleasant scenario (which, in case you had doubts, just recently happened to me):

Windows Update stopped working (as well as possibly other, more or less important components; desktop search commonly breaks as well)
If you are happen to figure out the cause being the AF drive, and search for solutions, you will fairly quickly get to the aforementioned KB articles, and obtain the hotfixes (which, BTW, are not offered for direct download, only via e-mail)
And now, the grand finale: Having downloaded the hotfixes to fix Windows Update, you cannot install them, because they rely on the Windows Update service to install! :):):)

It is absolutely mind-boggling that such a simple and obvious contradiction escaped Microsoft’s engineers who worked on these fixes. Furthermore, I found multiple forum threads mentioning this exact problem, some of which are even from Microsoft’s own forums, from 2-3 years ago:

All of them talk about either having to install the hotfix before the cloning (which you would never do unless you happened to have heard of this rather obscure issue before), or have to somehow install the files manually (which has its own downsides, as nothing will protect you if you screw something up).

Update: The last thread (from Social.Technet) mentions that it is possible to do a half-automated install, by extracting the files from the hotfix archive, and then running PkgMgr, as described here. This at least beats having to manually inject the DLLs into the system directories, although most users are not likely to discover this option.

Intel – The Hunt for the Driver

Let’s assume that you avoided the Microsoft issues, by timely application of the hotfixes. Turns out you are not out of hot water yet. To fully support 4K drives, the storage driver must also be updated.

Assuming you have an Intel SATA controller (which is the common case if you have a system with an Intel CPU), you will need an updated version of the Intel Rapid Storage Technology (RST) driver. Again, there seems to be a “discrimination through negligence” for Vista users: according to various sources (e.g., the Macrium forum thread), RST 9.6 or higher is required. If you have Win7, any of the versions on the main download page will work for you (although for older chipsets you may need to select an older version, like 11.x). However, if you select Vista, you will be presented only with very old drivers, the newest of which is 8.9, from 2009, back when it was called “Intel Matrix Storage Manager”, and it does not support 4K drives.

Fortunately, an up-to-date compatible driver does exist, although you have to poke around the web a bit longer to find it. You will find it under Intel® Rapid Storage Technology Driver for Intel Desktop Boards:

Version 9.6 for XP, Vista, Win7 and the server variants (claimed to be the first version to support AF drives) – for older (Core 2 generation) chipsets

Version 11.0 for XP, Vista, Win7 and the server variants (apparently the last version to support Vista) – for newer (Core i5/i7) chipsets, but should support Core 2 chipsets as well

Once the driver is installed and the system is rebooted, everything should finally work. To verify proper support of 4K features, run the following command from the command prompt (assuming your drive letter is C):

FSUTIL FSINFO NTFSINFO C:

In the output, look for the value for “Bytes Per Physical Sector“. For an non-AF drive it should be 512. For an AF drive it should be 4096. If you don’t have the right driver installed, it will show up as “not supported“.

Conclusion

It is really shameful, in my opinion, that Microsoft, despite still supporting Windows Vista, allowed such a glaring, crippling issue to slip. KB2470478 describes the symptoms as arising from hard drive replacement, so Microsoft obviously considered this scenario. I simply have no way to explain how, knowing of a potential issue that renders key system components dysfunctional, and having the fix for it, Microsoft still decided that it’s OK not to push this as a high-priority updates to clients.

It is also unfortunate that Intel apparently also forgot that some people still use Vista, and neglected to put up-to-date drivers on the main page for RST downloads. But it’s good that at least there are working drivers. 🙂

TL;DR – Quicklist for adding Advanced Format (4K) drive support to Windows Vista / 7

Fresh install

For Vista – use SP1 or later install media to properly align the partitions. For Win7 – any install media should work.
For Vista – install hotfixes KB2470478 and KB2553708. For Win7 – install hotfix KB982018 or Service Pack 1.
If you have an Intel SATA controller – install RST driver 9.6 or higher – for Vista get Version 9.6 or Version 11.0. For Win7 – you can get a newer driver from here (although the Vista ones should also work).
Enjoy!

Cloning

Install the hotfixes mentioned above before cloning to the new AF drive. For Vista – install hotfixes KB2470478 and KB2553708. For Win7 – install hotfix KB982018 or Service Pack 1.
The SATA driver can be installed already on the cloned drive (but probably better to do so earlier)
Recommended: use an up-to-date cloning utility that is AF-aware and will correctly align the partition to a 4K boundary (consult manufacturer documentation)
Enjoy!

If you already cloned without the pre-work

Download the relevant updates and install them manually by using the Windows Update Standalone Installer after stopping the Windows Update service.
If the above fails, try the Package Manager method as described here.
Cross your fingers and enjoy!

Unanswered Questions

Windows XP

According to Microsoft, WinXP is not AF-aware, so it does not explicitly support 4K drives. However, as far as I know, it should still work. In fact some manufacturers have proprietary technologies that can help account for XP’s lack of 4K-alignment in the driver firmware, so you may not even suffer performance issues.

It is unknown to me whether the aforementioned issues with ESENT applications that happen in Vista/7 without the relevant hotfixes will present themselves if you clone an existing XP installation. It is quite possible, but I haven’t seen it referred to anywhere, nor have I seen any fixes for it (the latter may be because Microsoft washes their hands completely of any AF support in XP). If the issues are present, it may be that it is actually impossible to clone an XP install and keep it functional. I am not going to try to find out. 🙂 In any case – Microsoft strongly advises against using XP on AF drives, due to possible unforeseen complications.

Non-Intel SATA Controllers

If the SATA controller your system drive is connected to is not by Intel, you will of course need to obtain the relevant driver from your manufacturer. As far as I know, most manufacturers should have relevant drivers available, but I haven’t tested any non-Intel controllers, so my write-up will not help you here. 🙂

Hello. I just wanted to let you know how helpful I found this information. I have a 12 year old laptop that was running Vista. I purchased a new SSD onto which I cloned the Vista drive with the intent to upgrade it to Windows 7 and then Windows 10. I did not want to upgrade the original drive because I needed to keep that with Vista due to a single program that I’ve only been able to get to work with Vista. My intention was to have both drives be bootable. As you can imagine, I ran into issues trying to upgrade Vista on the SSD. As far as I could tell, things were working OK, and I was able to start the install, but at the very end of the whole process, it threw up an error message about not being able to install the OS with this hardware configuration. I thought it was purely a driver issue, but I could never get it resolved. I knew Windows 7 would run on that hardware, so it never occurred to me that there was this issue with Vista. I had, at one point, tried a solution that did sort of install Windows 7, but it wasn’t really an upgraded version. It just threw the old OS into a separate folder and basically had a clean install of Windows 7, which was not what I wanted. Anyway, I eventually came across some other website that mentioned something regarding advanced format hard drives. It sounded like that was the issue, but no solution was offered. I had decided that I would clone the Vista drive to a third drive, upgrade the Vista drive, then clone that to the SSD and then transfer back the first clone to the original Vista drive. However, I then came across your post here, and decided to see about using the information you have here to deal with the Vista clone on the SSD. Although your links no longer work, I was able to find the hotfixes and the Intel RST driver. I installed the 11.0 version of the RST driver without issue. I extracted .cab files from the two hotfixes, and I used pkgmgr to install them. After that, I had no issues at all upgrading to Windows 7. So thank you for the huge help.

8 thoughts on “Windows Vista and Advanced Format Disks”

thehikingdad November 6, 20146:17 pm Reply

This is an unbelievable story.
As usual very well written, you should share this in some magazine. Maybe after getting enough attention from IT folks they will fix things in their Windows 115.
Max September 18, 20155:28 pm Reply

Thanks so much for the thorough explanation. I now know what I have to do to fix all the problems you mentioned cloning to an AF drive running Vista on an old Toshiba laptop. I’m attempting to replace the original 160GB drive with a 1TB. I used Acronis 2014 to create an image of the 160 GB drive. The cloned Vista runs on the new drive but I see ESENT reliant components not working.
Will September 25, 20165:57 pm Reply

I was fighting with a Vista recovery for a client for almost a month in trying to understand why the recovery did not produce a fully functional system. I didn’t find out about this reported issue first hand from your site but after learning about the issue, finding about KB2470478, installing Rapid Storage Drivers 9.6, and then continuing to have issues did it lead to me finding this site which would have saved me piles of issues from the very beginning. Still after that, I had a system that stuck on the vista loading screen forever 4/5 boots.

Prior to your site I had no idea there was a hard-to-find secondary update to address this issue and I also searched for newer than 9.6 drivers from Intel so kudos to you for finding the v11 drivers for Vista on Intel’s site. As an aside it’s unfortunate the latest version they produce is the 8.9 version if you select Vista as your operating system (but Intel’s web site has been crap for finding drivers for at least 8 years now).

I was able to get the updates into the system post-clone by stopping Windows Update and using wusa.exe.

In the event it aids others through Google searching, one of the eventlog hits prior to the first patch was:
The Cryptographic Services service failed to initialize the Catalog Database. The ESENT error was -583

Thanks for getting this site out there!
1. cloakedthargoid November 1, 20165:50 am Reply
  
  Thank you for your comments. I edited the page and added your suggestion of stopping WU service and using WUSA. Perhaps it will help someone who is stuck post-cloning. 🙂
megamawax June 20, 202010:46 pm Reply

Hello. I just wanted to let you know how helpful I found this information. I have a 12 year old laptop that was running Vista. I purchased a new SSD onto which I cloned the Vista drive with the intent to upgrade it to Windows 7 and then Windows 10. I did not want to upgrade the original drive because I needed to keep that with Vista due to a single program that I’ve only been able to get to work with Vista. My intention was to have both drives be bootable. As you can imagine, I ran into issues trying to upgrade Vista on the SSD. As far as I could tell, things were working OK, and I was able to start the install, but at the very end of the whole process, it threw up an error message about not being able to install the OS with this hardware configuration. I thought it was purely a driver issue, but I could never get it resolved. I knew Windows 7 would run on that hardware, so it never occurred to me that there was this issue with Vista. I had, at one point, tried a solution that did sort of install Windows 7, but it wasn’t really an upgraded version. It just threw the old OS into a separate folder and basically had a clean install of Windows 7, which was not what I wanted. Anyway, I eventually came across some other website that mentioned something regarding advanced format hard drives. It sounded like that was the issue, but no solution was offered. I had decided that I would clone the Vista drive to a third drive, upgrade the Vista drive, then clone that to the SSD and then transfer back the first clone to the original Vista drive. However, I then came across your post here, and decided to see about using the information you have here to deal with the Vista clone on the SSD. Although your links no longer work, I was able to find the hotfixes and the Intel RST driver. I installed the 11.0 version of the RST driver without issue. I extracted .cab files from the two hotfixes, and I used pkgmgr to install them. After that, I had no issues at all upgrading to Windows 7. So thank you for the huge help.
1. cloakedthargoid June 21, 20208:58 am Reply
  
  Hi. Glad this information was useful to you. And thank you for pointing out that the links were broken. It seems that Intel and Microsoft both had removed lots of Vista-related files from their servers since this was originally written. You can’t even find the KB numbers in the Microsoft update catalog anymore!
  
  I uploaded the relevant files to my drive and the links in the TL;DR section should be working now. The original info page links may be broken, but sometimes you can find the pages by feeding the links to the Wayback Machine (web.archive.org).
The Shadow February 24, 20219:39 pm Reply

This information here was useful for me too, thank you cloakedthargoid! One machine needed a new hard drive, because the old one was in bad shape and it runs Windows Vista which will be upgraded soon. However other issues happened at the same time and a quick ‘clone and forget’ solution was the way to do it for now. Your discoveries here saved me much trouble to figure out alone why things do not work. All things worked well after the clone job from the old 512 byte sector drive to the new advanced format disk. The only thing that broke and refuses to work anymore is Windows Update, but the OS was fully updated before so it’s not a big problem for me. Another fine example how people like you do the work of Microsoft better that their corporate bots! Their forums are mostly useless today for any complicated problem like the one you reported here. I wish you luck and good health!
1. cloakedthargoid February 24, 202110:39 pm Reply
  
  Thank you for your words of support. I am happy this information was useful. 🙂
  
  I am not sure, but Windows Update may be just broken on Vista nowadays. I haven’t been using it since the EOL in 2017, instead manually installing Server 2008 SP2 patches, which are compatible with 64-bit Vista, and are still ongoing. However, these are just security updates – feature-wise Vista has fallen way behind Windows 7, and so I finally bit the bullet last year and upgraded the desktop which was the subject of this research. You can do an in-place upgrade from Vista to 7that will keep all your data, programs and settings, if you prefer.
  
  You are right that you will not find solutions to any complex problems at the Microsoft forums. Been there, done that. 😦 Your best bet is MSFN. You can check out some of the amazing stuff they have going on in their Vista forum: https://msfn.org/board/forum/67-windows-vista/
  
  Wishing you all the best.