The Social Development Database

I’ve always been fascinated by development databases — more so sometimes than huge, heavily utilized production ones. Mainly because I’ve seen how the beginnings of a performance problem, or the start of an elegant solution takes shape within a development database. It’s one of the reasons why I love high levels of visibility through full DDL-auditing within development. I love to SEE what database developers are thinking, and how they are implementing their ideas using specific shapes of data structures.

One of the concepts I’d love to see is a “river of news” panel within development tools to see what is going on within a development database. Some of the good distributed source code control systems do this now.

Here’s a good example of what I mean:

http://github-images.s3.amazonaws.com/blog/2011/mac-screenshots/commits-full.png

Imagine if there was a panel in SQL*Developer or TOAD that looked something like this:

This wouldn’t be all that hard to implement if full DDL-auditing was turned on…

Oracle OpenWorld 2011–Reflective Thoughts

And so another OpenWorld has come and gone, and while I wasn’t able to attend in person this year, I was able to watch most of the keynotes live while following along with my peeps on Twitter.

It’s always interesting to see whether or not people are “impressed” with the announcements from Oracle during OpenWorld — a lot of that depends on your perspective. While the past couple of OpenWorlds brought us Exadata and Exalogic, I felt that there were a LOT of “engineered systems” announced in both the run-up to OpenWorld (Database Appliance, SPARC SuperCluster) and at OpenWorld itself (Exalytics, Big Data Appliance). If you’re keeping score at home, you now have at least the following set of engineered system components to choose from:

Exadata
Exalogic
Exalytics — an OBIEE high-performance system (Essbase, OLAP, TimesTen)
Database Appliance (mid-market 2-node RAC in a box)
Big Data Appliance (Hadoop, NoSQL, R and Infiniband connectivity)
Exadata Storage Expansion Rack
SPARC SuperCluster

I predict that integrators and Oracle sales engineers will be very busy putting together solution portfolios and configurations for large customers.

This bigger set of products also puts more pressure on Oracle to deliver a solid management console that can oversee multi-engineered system landscapes, and while the jury is out on Oracle Enterprise Manager 12c, there were several encouraging bits about it — including the ability to customize the screens and workflows in a whitelabel fashion.

Of course, in addition to the Big Data Appliance, which appears to be Oracle’s way of “legitimizing” Hadoop within the enterprise, and providing tighter integration through enhanced connectors over Infiniband, there was another Oracle database product “announced” in the form of Oracle NoSQL. From most accounts, the NoSQL product appears to be a well-engineered key-value store system based on the Berkley DB software.

Then we had the Oracle Public Cloud announcement and theater around Salesforce.com and their keynote. With the cloud, Oracle emphasized the their stance on the open, portable nature of Java and how you can easily move onto and off of their cloud. Two things about the Oracle cloud were particularly interesting to me: the possibility of getting access to “public” data sets on the cloud, and the Oracle Social Network.

Larry Ellison demonstrated the Oracle Social Network used within a company sales process as a collaborative activity streaming tool integrated with Oracle’s Fusion applications — which seemed to resonate well with the enterprise customers in attendance.

All in all, a lot of stuff — and I didn’t even cover the Fusion Apps stuff.

One final intriguing thought — now that Oracle has so many different database products: RDBMS, NoSQL, Essbase, TimesTen and Rdb — it will be interesting to see how they “integrate” them, possibly on their cloud. I can imagine a future in which you don’t choose your product, but rather your feature and usage requirements, something like this:

Oracle Public Cloud Data Configuration

Describe your data requirements:

I need high-volume access to keys and values, I am less concerned about consistency
I need tables and columns that I can use to create relations and views to support ad-hoc queries and analysis
I need faceted, multi-dimensional analysis structures to support numerical analysis
I have a lot of documents and my data is basically unstructured.

Describe how your want to access your data:

I need JDBC / SQL connectivity
I need a RESTful API
I need a SOAP API

And then underneath the covers the cloud provisions the correct product for you, while watching your usage to see if it needs to configure a different product…

Exalytics and the cloud / OpenWorld kickoff

At yesterday’s Oracle OpenWorld keynote address, Larry Ellison spent a lot of time reviewing the impressive achievements of both the Exadata database machine and the Exalogic middle-tier application machine — extolling the purpose-built nature of both systems around what he termed to be the foundations of business data processing value. In particular, the parallel nature of scanning and handling large amounts of structured data on Exadata, the ability of Exalogic to run reams of Java, and perhaps most important of all, the fact that Oracle has made a significant bet on Infiniband to rapidly move data around within and between the systems.

Referring to Ethernet as being “from the 60′s”, it’s clear that Oracle thinks it’s time to move past it for handling large data transfers.

It was interesting to see Larry try to have it both ways in the keynote — asking what the purpose is of IBM’s “fastest integer” processor, “that’s great, but it’s the fastest for what?” — and then proceed to talk about the SPARC SuperCluster as a general purpose machine.

In any event, the star of the keynote was the 3U rack-mountable Exalytics “Analytic” machine — a high-memory, high-compute “node” that provides OBIEE / Essbase / OLAP folks with their very own engineered system. By cramming memory (1TB) and cpu (40 cores) along with the in-memory TimesTen database technology into the box, Larry described a system that allows for analysis “at the speed of thought”. If you’re already an OBIEE user, this system should provide you with plenty of excitement.

Less clear is how all of these engineered systems (including the yet-to-be-described Big Data Appliance / Hadoop machine on display at OpenWorld) will be put together by integrators and customers to provide an analytic / high-transaction data processing cloud. It’s as if Oracle is slowing replacing each item on its software price list with a hardware “systems” item — it will be interesting to see how these systems get put together into solution portfolios. For example, does it make sense to buy an Exadata half-rack and fill the remaining space in the rack with Exalytic machines? Would such a configuration be supported? Encouraged?

Back to the purpose-built machines — how does this play against the cloud trend of ubiquitous, generic nodes and software tailored to that environment?

I actually think we’ll know a lot more about this interplay (and how Oracle intends to adapt to or shape the discussion) as OpenWorld proceeds — especially around customer expectations for keynotes around big data and the cloud.