Database Technology Trends

Sybase IQ

Sybase’s secret is out. Gartner officially acknowledges that Sybase IQ belongs into the leader quadrant of its Data Warehouse Database Management System Magic Quadrant. Click here to read Sybase’s announcement.

I am working with Sybase IQ since 2001 and I always knew that the column vector approach has tremendous advantages in a large volume data warehouse environment. As for many other products of Sybase, the focus was solely on the superior database engine. This pretty much excluded all non technical people from experiencing the Sybase IQ advantage. Click here to read about the latest performance record set by Sybase IQ.

With the introduction of Sybase IQ Options, these advantages are now transparent to not so technical people as well. This is an important step in the right direction. Database technology is not driven by DBAs and infrastructure managers, but by business analysts and application architects. Click here to read more about Sybase IQ Options.

I think this will positively impact the role Sybase IQ plays in the data warehouse market. Hopefully Sybase marketing will take full advantage of this opportunity. 

Sybase ASE 15.5 IMDB

In my last post I wrote about in-memory database and their advantages. Sybase ASE 15.5 will provide this so called IMDB in its core engine, which means that there’s no need to change your application code to connect to the Sybase ASE IMDB.

Sybase released a new white paper on how to apply performance tuning to the Sybase ASE in-memory database. Yes, even in-memory databases need some TLC. The report also outlines my comments on where IMDBs are most suitable to solve performance problems. Heavy write intensive applications are the top beneficiaries, as long as the data is not needed for long term storage. E-commerce applications are probably the best example. But there are other situations where an IMDB will provide an alternative. Any data collection application that aggregates data end only writes the result set into a permanent storage is a good candidate for IMDB.  Click here to read the entire report.

Note

This is the latest update from Sybase. As always, please feel free to comment on this post. I would love to hear your feedback.

First of all I have to apologize to my loyal readers for the long absence from my blog. In simple terms, “I got busy”. But in these economic times, I guess this is a good thing. I don’t want to give a promise I can’t keep, but I will do my best to keep this blog up-to-date.

The past few years were dominated by all major database vendors introducing and improving their database cluster products. There is the bread of shared nothing clusters like Microsoft SQL Server 2008 and there are the share everything clusters like Oracle and Sybase. You can read all about this in my previous post “Grid Databases – The Future of Database Technology?“.

It is amazing how far these technologies have come and how much we got used to “always available” databases. You know what’s coming next. Now, that we have uninterrupted access to data, it would be great if we get the data faster. Well, the database vendors have an answer for that as well.

It was about 7 years ago when I first was introduced into the concept of in-memory databases. At the time it was less known database vendor called Times-Ten that offered an in-memory database with blazing performance metrics, hence times ten. It was the perfect answer to solid state disk drives that could drain an IT budget in a hurry.

Apparently this technology was so intriguing that Oracle decided to buy Times Ten and make it Oracle’s in-memory database. The only downside to this is, it is not an Oracle database in memory, it is Times Ten’s engine running in memory. This creates admin nightmares to have special skills to manage the Times Ten engine in addition to the Oracle server, as well as different software development techniques for both systems. Performance gains out weight manageability concerns, I guess?

Just recently Sybase announced its Sybase ASE server, in version 15.5, will have an in-memory engine equivalent that will provide the same functionality and manageability as the standard Sybase ASE server. This is a remarkable step, because it provides performance gains transparent to client applications and the database engine will not challenge DBAs to learn new skills. To me this is a win-win situation.

Microsoft is still in the planning and rumor phase of providing an in-memory database for its next version of SQL Server. The code name for the next SQL Server upgrade is Kilimanjaro. This is the name to use when searching for upgrade information. It is not clear when the new SQL Server release will be available and it is not clear if it will be named SQL Server 2010. It depends if it gets out this year or not.

IBM has its own in-memory database for DB2 and I believe it is a Java based and Java supporting engine. I have to admit that I’m not as fluent with DB2 as I wish to and please add your comments to this post if you’re a DB2 expert.

Having listed all the in-memory contenders, the question pops up “What about Sybase IQ?” or any other data warehouse database for that matter, Terradata and Netezza for example.

The answer lies in the architecture of in-memory databases. They are designed to improve transaction processing volume, the classic OLTP applications. Data warehouses would not have any benefits from in-memory databases. In-memory databases provide extreme high-speed transaction processing without the need to confirm disk write success. Traditional databases have one thing they have to do to ensure data integrity. They all need to wait for the disk i/o to confirm a write to disk. Database vendors came up with very complex and sophisticated caching techniques to overcome this performance challenge. But they cannot ignore this fundamental requirement.

In-memory database bypass this disk writing requirement and that’s what improves the speed. Designed for high volume transaction systems, like e-commerce shopping carts, in-memory databases are unbeatable when it comes to writing transaction data. And this is fundamentally different to data caching of traditional database engines. Data caching improves read performance, but does nothing to improve write performance.
There is a downside to these databases as well; they offer alternatives to performance problems in poorly written applications. Like powerful hardware, in-memory database have the potential to mask poor application development. We might see an explosion of in-memory database implementations due to this matter.

Bottom-line: this is cutting edge technology that will give database architects another tool in the toolbox to design the most effective database environment. Do yourself a favor and try to get your hands at a test environment to experience this technology first hand. Yes, 2010 could be the year of in-memory databases.

Thanks for listening,
Peter

TAMPA, Fla., November 10, 2009. Ripley Entertainment contracted with Dobler Consulting in July, 2009 to use his IT Solutions Architect expertise for their new company-wide Intranet portal. They needed an Intranet facelift to match the look, feel, and versatility of their external website, while using existing Microsoft SharePoint® technology.

The major challenge for Peter Dobler was to find a better way to create global collaboration for Ripley’s employees. The company has 74 locations in 13 countries. For the collaboration challenge, Dobler says “Microsoft SharePoint® is an excellent technology, but not attractive or simple for end users to use. It is not a technology that can easily turn a website into a friendly working space.”  Dobler worked with Ripley’s Marketing Department, who created the look and feel of the Intranet design.

The original SharePoint® portal workflows were used infrequently. Dobler added these workflows to the new website design, making certain they were quick to find and utilize. He included menus, reporting, an integrated discussion forum, and attractive screens for employees to collect/share information, and work together on global projects from all locations. The upgraded system enabled employees to raise their work performance exponentially.  Team efficiency and productivity improved rapidly.

The new system architecture provided additional benefits for data protection and security.  Data security challenges were solved through careful planning to ensure no breaches would occur. Dobler used the built-in security capabilities of SharePoint®, and added custom data security measures to protect valuable business data that met Ripley’s standards.

Dobler had eight weeks to update Ripley’s internal site, and implement solutions for their business goals using SharePoint® technology. By the second week of September, Dobler finished the project on-time and within budget. Today, Ripley’s new system uses SharePoint® to its maximum advantage, supports employees collaborating with a wide distribution of data at their fingertips, and maintains data security, aligned with company requirements.

Dobler’s approach to integrating technology with business goals requires “always listening to your clients, and meeting their business expectations. Our goal is to plan, design, build, and implement projects with fast turnaround and no delays.”  Dobler Consulting offers proven experience across many platforms, along with the skills to analyze a customer’s business, offer comprehensive solutions, and bring projects to a successful completion.

More information about how Peter Dobler solves clients’ Intranet challenges by focusing on adding business value, is available at http://www.doblerconsulting.com. He can be reached at 813-322-3240.  

About Ripley Entertainment

Ripley Entertainment (http://www.ripleys.com) is the largest international chain of museum-type tourist attractions in the world. Ripley Entertainment owns, operates, and franchises a variety of attractions, including Great Wolfe Lodge Indoor Water Park Resort in Niagara Falls, Ontario, Canada, world-class aquariums, Ripley’s Believe It or Not! museums, Guinness World Records Museums, and Louis Tussaud’s Waxworks.

Ripley Entertainment of Orlando, Florida, owns 74 exciting attractions in 13 countries, best-selling books, a live-action network television series in daily syndication in over 70 countries, and the ninety-year-old, longest continuously published newspaper comic in the world, the classic Believe It or Not! cartoon.

Ripley Entertainment is owned by the Jim Pattison Group. The Jim Pattison Group is headquartered in Vancouver, BC, Canada, and is comprised of over 410 locations worldwide focusing on the automotive, media, packaging, food sales and distribution, magazine distribution, entertainment, export and financial industries.

About Dobler Consulting

Dobler Consulting is a leading information technology and database services company that offers cutting edge technology and integration for their clients. Founded in 2000, the Tampa consulting firm delivers implementation expertise for Oracle, Sybase, and MS SQL Server. Dobler Consulting has over 20 years of proven experience, working with their clients to improve database efficiencies and reduce costs. Dobler Consulting serves local and southeast regional clients with their world class services and products.

                                                                                                ###