Katmai Public CTP / Dundas Deal

I’m not at TechEd so this is second-hand news, but two big announcements: first of all, the first public CTP of Katmai is available for download on Connect; secondly, and more interestingly, a deal has been done where Microsoft has licensed Dundas’ data visualisation components. Russell Christopher has the best breakdown of this deal I’ve seen so far here:
He’s right in wondering whether the OLAP component is part of this deal – that’s the big question from the AS point of view.
 
UPDATE: see Russell’s comment below – the OLAP components (http://www.dundas.com/Products/Chart/NET/OLAP/index.aspx) are part of the deal! For me, the obvious use is as a replacement for OWC, not just instead BI Development Studio but as a free component that anyone developing a thick/thin client for Analysis Services can use. Next question: does licensing the components mean that Microsoft can now give them away for free like this? Or can it only use them embedded in its own products?

Batch Reporting With SSIS and OfficeWriter

I’m a long-standing fan of OfficeWriter, the tool that’s just been licensed by Microsoft for possible inclusion in Katmai Reporting Services, and recently I was engaged by Softartisans to write a few articles for their website (yes, that means I was paid). Here’s the first of them, on how to create a batch reporting solution using their components and Integration Services:
 
Seems a bit of a weird thing to want to do when you can do the same thing in Reporting Services, but as I say in the article there are some advantages for using Integration Services for this task. I’m going to write another article next week on using OfficeWriter with Excel 2007 and Analysis Services which I’ve got some fun ideas for…

The Rumour Mill

Mark Whitehorn has an interesting non-story over at the Register:
What was going on here? Perhaps something was going to be announced that couldn’t be announced at the last minute? Well, I did hear some rumours about… hold on, someone’s knocking at my hotel room door. Who could it be at this time of night? Be back in a minute…

OLAP or Relational?

If there’s one big religious divide within the BI world, greater than the differences between vendors, then the question of whether to use an OLAP database or to query the relational database directly is it. Standing in the pro-OLAP camp as I do I probably have more in common with an Essbase guy than someone who wants to do BI with the SQL Server 2005 relational database exclusively. Anyway, here’s an article by Ralph Kimball in Intelligent Enterprise that sums up the arguments on both sides pretty well:
I’m pleased to see that he makes much of MDX as a plus-point on the side of OLAP; even Oracle’s supposedly all-SQL approach begins to look a bit MDXy when you see the details (see for example Mark Rittmann’s post, also from today: http://www.rittmanmead.com/2007/04/30/obi-ee-time-dimensions-and-time-series-calculations/) although from what I’ve seen MDX still has some important advantages. It’s just a pity that as a language it seems to be fragmenting into different vendor-specific implementations so quickly – for example, see this post from the Panorama blog on SAP BW MDX: http://www.panorama.com/blog/?p=44.
 
 

Business Objects to buy Cartesis

Industry consolidation continues – at this rate there’ll be about three vendors left. Andy Hayler says pretty much everything that needs to be said here: http://andyonenterprisesoftware.com/2007/04/another-one-bits-the-dust/
 

AS2005 Design Best Practices White Paper

Via Darren Gosbell, I see that the best practices included in the forthcoming SQL2005 Best Practices Analyzer have been turned into a white paper which you can download here:
 
Most of the recommendations are fairly obvious, some were new to me, some provoked a ‘they need to fix that’ response, and some I wasn’t sure I agreed with 100%. For example:
 
Avoid creating diamond-shaped attribute relationships
I quite often find myself designing diamond-shaped relationships in my attributes; the example they give in the text isn’t particularly good, but Day->Month->Year and Day->Week->Year is very common. OK most of the time I design user hierarchies along these paths anyway, but this need to design user hierarchies just for the sake of performance rather than because users actually want to see these hierarchies (and this isn’t the first time I’ve heard this recommended) is something that I don’t feel particularly happy about. It would be nice if we could make the choice between using attribute hierarchies and user hierarchies based on ease-of-use alone.
 
Avoid including unrelated measure groups in the same cube
This is the multiple measure groups and one cube vs multiple cubes with one measure group question that has been kicking around for at least a year. We were promised it was going to be addressed in the AS2005 Performance Guide but it wasn’t; when are we going to get some details published? In my experience I have seen a slight improvement in performance when you split cubes up in this way but nothing major, yet clearly there must be some reason for MS to keep recommending this so perhaps I’ve not come across the right scenario yet.
 
Avoid having very big intermediate measure groups or dimensions of many-to-many dimensions
Obviously having large intermediate measure groups and/or dimensions in m2m relationships is going to slow things down, but in my experience I’ve always been pleasantly surprised with the performance of m2m dimensions. I’ve seen intermediate measure groups with much more than 1 million members in perform really well…
 
Avoid having partitions with more than 20 million rows
As an aside, I recently noticed that in Eric Jacobsen’s recently blog entry on partitioning here he says you can also think about 2Gb (rather than a number of rows) as a rough guideline for the maximum size of a partition, and more interestingly that you should not have more than about 2000 partitions in your measure group. I asked him about this and it turns out that there are some internal limitations in AS at the moment, which hopefully will be fixed soon, that mean that slow down performance when you have large numbers of partitions. This does suggest that at the moment roughly speaking there’s a maximum size for a MOLAP cube to perform well of around 4Tb or 30 billion rows… not that I’ve ever seen a AS2005 MOLAP cube that big, but interesting to note.
 
Do set the Slice property on partitions that are ROLAP or partitions that use proactive caching
Based on Eric’s article mentioned in the last point, I think it’s also a good idea to set the Slice property on MOLAP partitions where possible too given that the automatic detection of which members appear in which partitions gets confused by overlapping slices. Greg Galloway recently did some experiments on this which I saw where he showed that if you set the slice on a MOLAP partition the auto-slice information isn’t used.
 
Avoid creating aggregations that are larger than one-third the size of the fact data
I quite frequently find myself designing aggregations which fail the one-third rule, although not by much, and for certain queries and calculations it can be a good idea. But I agree you should only do so as a last resort.

SQL2005 Samples on Codeplex

The SQL 2005 samples are now available for download from Codeplex:
http://www.codeplex.com/SqlServerSamples
 
Nothing you can’t get from the usual sources, of course, but at least now you can download the bits you want individually; the site will also act as a pointer to other SQL Server projects on Codeplex too.