Database Technology Trends

First of all I have to apologize to my loyal readers for the long absence from my blog. In simple terms, “I got busy”. But in these economic times, I guess this is a good thing. I don’t want to give a promise I can’t keep, but I will do my best to keep this blog up-to-date.

The past few years were dominated by all major database vendors introducing and improving their database cluster products. There is the bread of shared nothing clusters like Microsoft SQL Server 2008 and there are the share everything clusters like Oracle and Sybase. You can read all about this in my previous post “Grid Databases – The Future of Database Technology?“.

It is amazing how far these technologies have come and how much we got used to “always available” databases. You know what’s coming next. Now, that we have uninterrupted access to data, it would be great if we get the data faster. Well, the database vendors have an answer for that as well.

It was about 7 years ago when I first was introduced into the concept of in-memory databases. At the time it was less known database vendor called Times-Ten that offered an in-memory database with blazing performance metrics, hence times ten. It was the perfect answer to solid state disk drives that could drain an IT budget in a hurry.

Apparently this technology was so intriguing that Oracle decided to buy Times Ten and make it Oracle’s in-memory database. The only downside to this is, it is not an Oracle database in memory, it is Times Ten’s engine running in memory. This creates admin nightmares to have special skills to manage the Times Ten engine in addition to the Oracle server, as well as different software development techniques for both systems. Performance gains out weight manageability concerns, I guess?

Just recently Sybase announced its Sybase ASE server, in version 15.5, will have an in-memory engine equivalent that will provide the same functionality and manageability as the standard Sybase ASE server. This is a remarkable step, because it provides performance gains transparent to client applications and the database engine will not challenge DBAs to learn new skills. To me this is a win-win situation.

Microsoft is still in the planning and rumor phase of providing an in-memory database for its next version of SQL Server. The code name for the next SQL Server upgrade is Kilimanjaro. This is the name to use when searching for upgrade information. It is not clear when the new SQL Server release will be available and it is not clear if it will be named SQL Server 2010. It depends if it gets out this year or not.

IBM has its own in-memory database for DB2 and I believe it is a Java based and Java supporting engine. I have to admit that I’m not as fluent with DB2 as I wish to and please add your comments to this post if you’re a DB2 expert.

Having listed all the in-memory contenders, the question pops up “What about Sybase IQ?” or any other data warehouse database for that matter, Terradata and Netezza for example.

The answer lies in the architecture of in-memory databases. They are designed to improve transaction processing volume, the classic OLTP applications. Data warehouses would not have any benefits from in-memory databases. In-memory databases provide extreme high-speed transaction processing without the need to confirm disk write success. Traditional databases have one thing they have to do to ensure data integrity. They all need to wait for the disk i/o to confirm a write to disk. Database vendors came up with very complex and sophisticated caching techniques to overcome this performance challenge. But they cannot ignore this fundamental requirement.

In-memory database bypass this disk writing requirement and that’s what improves the speed. Designed for high volume transaction systems, like e-commerce shopping carts, in-memory databases are unbeatable when it comes to writing transaction data. And this is fundamentally different to data caching of traditional database engines. Data caching improves read performance, but does nothing to improve write performance.
There is a downside to these databases as well; they offer alternatives to performance problems in poorly written applications. Like powerful hardware, in-memory database have the potential to mask poor application development. We might see an explosion of in-memory database implementations due to this matter.

Bottom-line: this is cutting edge technology that will give database architects another tool in the toolbox to design the most effective database environment. Do yourself a favor and try to get your hands at a test environment to experience this technology first hand. Yes, 2010 could be the year of in-memory databases.

Thanks for listening,
Peter

There are 2 major database vendors working on their next big version of their database engines. Microsoft and Oracle are getting ready to release their best database system yet. Well, in the near future at least. Nevertheless here are some preliminary infos that leaked from the development teams.

Microsoft SQL Server 2010

Just last year in August we were introduced to SQL Server 2008, which finally brought us backup compression and data compression amongst many other new features. Many SQL Server customers are still recovering from the SQL Server 2005 migration and find it difficult to keep up with this breath taking speed of new releases.

So what’s new in SQL Server 2010?

It will build on the data warehouse improvement of SQL Server 2008 and adds even more support for multi terabyte databases.

The main focus of SQL Server 2010 will be on “managed self services”. Self tuning will be achieved by interpreting the Dynamic Management Views (DMV). Is this the death of the DBA? Not at all, it will redefine the skills and duties of a DBA in the day to day operations. But then again, let’s see if and how this works.

Emphasis on policies is another big change. Many policies are already available since SQL Server 2005, but in SQL Server 2010 they will be enforced by default.

The last improvement is focused on better email integration and integration into the Web 2.0 environment. Imagine; SQL Server goes Twitter.

After all, these are preliminary information available through some rumor mills and a little bit from the Microsoft website. One thing is for sure, with the release of SharePoint 2010 (beta available now), SQL Server 2010 will become even more important.

I’m pretty sure that there will be more information available soon.

Oracle 12g

Yes, you heard right. Oracle 12g is around the corner. There is not much information available on this new release. The only detail that leaked so far is that Oracle 12g won’t support raw filesystems anymore. This is bad news for RAC environments. The OCR and the voting disk relay on raw filesystems via CFS like OCFS.

The word is that ASM will step in and close the gap in 12g. Also, more emphasis on NFS will be placed as well.

Other than that, there’s not much information regarding functionality enhancements available. As soon as I get more details I will post it.

Sybase is not in the radar to release yet another major release in the near future. The focus is on synchronizing the ASE 15.0.3 release with the Sybase ASE CE (Cluster Edition) version. There is also a new project that will replace Sybase Central with a web based management tool. The ASE (standard and cluster edition) is already available.

Sybase just released a couple of major new releases in their product line, Sybase IQ 15, Sybase Replication Server 15 and Sybase ASE Cluster Edition mid last year. There are new major releases in planning, but not released in the near future like Microsoft and Oracle. That’s at least to my knowledge. One thing is remarkable with Sybase; they had the best quarter in Q1 of 2009 and I can’t wait to get the results for Q2.

One thing is always interesting to observe. This constant competition and the need to outperform drive these vendors to constantly push the envelope and we as the consumer will get better, faster and cheaper products.

The downside is that we have to constantly upgrade our systems. Over time this creates enormous strains on IT staff and budgeting. It seems that the pace of new major database releases has picked up noticable and it remains up to the IT managers to make the right call at the right time. The current cutting in staff and budgets is no help either.

Database vendors are packing more and more value added features into their systems to gain more customers and sell their product. Hopefully we will see a speedy recovery of the economy to enable these companies to bring back staff and put all these great features to work soon.

Thanks,

Peter Dobler

Turns out that maintaining a blog requires time and efforts. That’s why so many blogs went silent in the past few months. Regarding a source of the NY Times (Blogs Falling in an Empty Forest) bloggers are abandoning their beloved blogs in an increasing rate. The good news is that this will weed out 95% of all the competitors.

I have to admit that I fell into a blog fatigue myself. After blogging a few articles that created a lot of interest in the market space I got wrapped up in a lot of work for my company and ignored my blog all together.

Many of my fellow colleagues were constantly asking me when I will release my next article on the blog. I chose to ignore these requests and deemed the blog as too much work for not much in return. But times are changing and the current recession is very challenging for small businesses to stay afloat.

The one thing the last recession proofed was that the companies that were able to keep their names on people’s minds, either through advertising or aggressive mouth to mouth promotions, came out ahead once the economy recovered.

Of course advertising costs money and money is tight during a recession. But there’s a way to bypass that. Blogging is essentially free and a great tool to keep your name in people’s mind. Especially in the consulting business it is very hard to actually create a direct response marketing campaign. Circulating your name is the best method to keep you on a possible short list in the future.

So, this is reason enough for me to re-launch my blog. There will be summaries and reviews of new database features recently released by the major database vendors. I will also add a new topic covering content management issues. Besides a multi decade long experience in database architecture and management I also added Microsoft’s SharePoint as a strategic tool to my company and the blog will feature articles that will discuss SharePoint features not many people are aware of.  Whenever possible there will be real life experiences as well.

Having said that I now have to go back to the drawing board and get busy with the next blog series.

As always, thank you for stopping by and your continued interest in my views.
Thanks,
Peter