White paper on resolving query performance problems

Another great and very detailed white paper from the SQLCat team entitled "Identifying and Resolving MDX Query Performance Bottlenecks in SQL Server 2005 Analysis Services". You can download it here:
 
There’s loads of information here I’ve not seen before, for example on Perfmon counters. A must read! 

AS2008 webcast now available

If, like me you missed the recent AS2008 new features webcast then you can now download the recording here:
 
It’s a very good summary of what’s coming, although the content of the presentation contains no major new revelations. The question/answer session is a bit more revealing: we’ll be getting what sounds like very basic execution plans (possibly visual), there’s no LINQ integration as yet, and there are no changes to SSRS/SSAS integration (WHEN are the people in Redmond going to wake up and do something about this???). 

Post-holiday round-up

The worst thing about taking a holiday is coming back home and, despite having taken my laptop with me and checking my mails a few times, finding there are a gazillion emails waiting for me to follow-up. Hohum. Anyway, here are a couple of things that need mentioning…

First of all, registration is open for the next BI evening in London on September 26th:
http://www.sqlserverfaq.com/

There’s also a whole load of new stuff up at the SQLBits site, including some sessions (though not mine yet) and speakers:
http://www.sqlbits.com/

You can register for the conference here:
http://msevents.microsoft.com/CUI/EventDetail.aspx?EventID=1032349295&Culture=en-GB

I see Vidas Matelis has picked up some more useful snippets of new features in AS2008 from a recent webcast:
http://www.ssas-info.com/VidasMatelisBlog/29_ssas-2008-katmai-info-from-august-9th-webcast#more-29

I missed the main webcast on the wider changes (originally billed as just being about the time series algorithm but it seems to have had its scope widened) in AS2008 but it looks like the recording should be available soon:
https://connect.microsoft.com/SQLServer/content/content.aspx?ContentID=6194

PerformancePoint CTP4 has been released and can be downloaded from Connect. David Francis has a feature list:
http://blogs.conchango.com/davidfrancis/archive/2007/08/16/PerformancePoint-CTP4-now-available.aspx

I also received a copy of Marco Russo’s new book "Introducing Microsoft LINQ". I won’t be reviewing here because I’m not really qualified to do so, but from the point of view of someone whose dev skills are pretty basic it looks like a good introduction to the subject.

SQLBits and the next BI Evening

I’ve been meaning to blog about these two events for a while but somehow not got round to doing so…
 
Anyway, first date for your diary is the evening of September 26th when the next BI evening will be held in London, at the offices of IM Group. Registration isn’t open yet (I’ll update this post when it is) but there will be two speakers:
 
Suranjan Som of IM Group:
Data Mining in practice – the Microsoft Way
Data Mining has come a long way from being a black art to a contemporary tool that allows businesses to unearth the hidden potential in their data. Come and join us for a whirlwind that looks how one can leverage data mining to address business problems using the new features in SQL 2005/2008.
Mark Hill of Edenbrook:
What’s new in the SQL2008 relational engine for BI?
How does Katmai change how we do MS BI projects, Mark Hill takes a look at the planned improvements such as CDC and UPSERT and what impact they will have followed by couple of demos on how these new features can be used.
 
Even more exciting, on Saturday October 6th is the first SQLBits community day at Microsoft in Reading. It’s a free one-day event concentrating on all things SQL Server, kind of a SQL version of Developer Day, and you can find out more here:
Again, registration isn’t open yet but we are looking for speakers and sponsors so please get in touch through the site if you’re interested in doing either. For my sins I’m helping organise the BI/DW track, so hopefully I’ll see you there!

MDX Editor for SQLMS

Ashton Hobbs has just posted a very early version (ie it’s a bit buggy and Ashton is looking for feedback) of an MDX editor he’s working on that integrates with SQL Management Studio and adds some of the more obvious functionality that SQLMS is missing. You can read more about it here as well as download it:

http://withnolock.com/communityserver/blogs/dirtyread/archive/2007/08/06/new-mdx-editor.aspx

Here are a few more details:

The Editor provides Intellisense, Snippets, and the grid supports any number of specified Axis.  I’ve only included one snippet initially for parallelperiod, but people can create their own (they’re stored in My Documents\My SSMS Snippets).  With ParallelPeriod snippet, I’ve added a custom snippet token tag called DateLevel which will pop down all levels from Date dimension for the cube.  You can invoke the parallelperiod snippet using its shortcut “pp” or by pressing Ctrl+Shift+P to invoke snippet menu (although seems to work in some and not other SSMSs).  Ctrl+Tab will invoke the Intellisense drop down.  F5 executes a query.  The treeview also has tooltips on each of the nodes that provide more detailed info than standard SSMS.

There are several other items I want to add like additional snippets (if anyone wants to make any and share that would be great J), function intellisense, export options, and any other MDX thing that might be useful.

If anyone does try it out then I would be interested to hear your thoughts and whether it’s something people would use (if so, I’ll continue working on it), also if there any found bugs.

What’s new in AS2008?

There are a whole bunch of new white papers detailing new features in SQL2008 (you can see the complete list here) but I thought I’d highlight the BI paper:

http://www.microsoft.com/sql/techinfo/whitepapers/hosting_sql_2008_bi.mspx

It’s the first time I’ve seen a fairly detailed discussion in public of what’s going to be new in SQL2008. Here’s a section on what’s new in the AS engine:

The premise of Online Analytical Processing (OLAP) is that instant access to accurate information enbles end users to answer even the most complex questions at the speed of thought. Thus, the aim to continuously excel in providing even faster query times and data refresh rates is a priority during the development process of any Microsoft SQL Server Analysis Services release, an aim that naturally also has been driving the release of SQL Server 2008 Analysis Services.

SQL Server 2008 includes Analysis Services that enable you to drive broader analysis with enhanced capabilities, including complex computations and aggregations. Analysis Service provides enterprise-scale performance through:

· A flexible caching model. With Analysis Services, you can control how data and aggregations are cached to optimize query performance while maintaining an acceptable level of latency between the cache and its underlying data store.

· Declarative attribute relationships. In an Analysis Services dimension, you can explicitly declare relationships between attributes in a hierarchy. This enables Analysis Services to pre-generate aggregations when a cube or dimension is processed, which improves runtime query performance.

· Block computation. Block computation eliminates unnecessary aggregation calculations (for example, when the values to be aggregated are NULL) and provides a significant improvement in analysis cube performance, which enables users to increase the depth of their hierarchies and complexity of computations.

· Writeback to MOLAP. Analysis Services 2008 removes the requirement to query ROLAP partitions when performing writebacks, which results in huge performance gains.

· Scale-out Analysis Services. A single read-only copy of an Analysis Services database can be shared between many Analysis Servers through a virtual IP address. This creates a highly scalable deployment option for an Analysis Services solution.

 The two points here are the biggies. Block computation should significantly increase the performance of many calculations that don’t perform well on SQL2005; writeback to MOLAP should finally solve the biggest weakness of AS for financial applications, namely that writeback performance at the moment is rubbish (maybe PerformancePoint will consider it good enough to use now!).

SQL2008 July CTP Released

You can get it from Connect, as always:

https://connect.microsoft.com/SQLServer/content/content.aspx?ContentID=5395

I’m not going to install this CTP because a) I’m about to go on holiday and b) there isn’t a VPC available yet, although one is coming in a few weeks.

What’s new in AS? Well, according to the docs nothing much – just an improvement to the time series algorithm in data mining. Is that it, I hear you cry? Well at the moment there are two possibilities as far as I can see: either the AS team have done their usual bad job of telling anyone what they’ve implemented, or given the new policy of only releasing finished code in the CTPs they’ve not released anything because it’s not finished. I was expecting to see some new features in this release (along the lines of what Vidas Matelis blogs about here: http://www.ssas-info.com/VidasMatelisBlog/28_ssas-2008-katmai-upcoming-changes-in-the-next-ctp) but I’ll find out what’s happened.

Some news on the RS front though:

Reporting Services – New Server and Designer

Improvements represent the two major infrastructure changes for Reporting Services. Reporting Services enhances the processing engine and rendering extensions to enable new functionality, such as Tablix support, and scalability as well as remove the dependency on IIS.  Additionally, new report designer and configuration tool are provided that improve usability and workflow for RS customers.

Oh, and if you’re one of the few people who’ve been using Notification Services – bad luck, it’s dead:

 

5.1 SQL Server Notification Services Removed from SQL Server 2008

SQL Server Notification Services will not be included as a component of SQL Server 2008, but will continue to be supported as part of the SQL Server 2005 product support life-cycle. Moving forward, support for key notification scenarios will be incorporated into SQL Server Reporting Services. Existing Reporting Services functionality, such as data driven subscriptions, addresses some of the notification requirements. Features to support additional notification scenarios may be expected in future releases.

Panorama: One Year On

After the Proclarity acquisition last year many people, myself included, thought the writing was on the wall for Panorama: after all the two companies’ product lines were very similar and if Proclarity was going to be supplied by Microsoft then there wasn’t going to be much point in looking at Panorama any more. However, one of the things that surprised me at the Microsoft BI Conference a few months back was the big display that Panorama put on. A big stand in a central location with leggy girls luring the attendees (at least the male ones) to it, a party at the top of the Space Needle – this was a company that was not dead, or at least making a pretty big effort to show that it wasn’t dead.

Of course the real test is whether the software is any good or not. In keeping with their bullish mood Panorama were handing out DVDs with their Novaview suite pre-installed on a virtual machine (you can download it here: http://challenge.panorama.com/forms/default.aspx) and since it was a while since I’d last seen what they’d got to offer (and after some encouragement from their marketing department) I was curious to check it out. After a lot of false starts surrounding licence keys etc and help from Panorama – and I have to say that in my experience their pre-sales support has always been very good – I got it running on my laptop and thought I’d share my impressions here.

I have to admit I was disappointed with the Novaview Desktop tool at first: it didn’t look as if anything had changed in the last few years. The UI looks very outdated in a VB6 way and while it’s easier to use than I remember, I’m still not convinced that it’s as intuitive as it should be. Even worse, within a few minutes of using it I got one of those unhandled (although unfatal) error messages that Panorama was always famous for – which simply isn’t acceptable today. These might be purely cosmetic points but users are more interested in this type of thing than some obscure aspect of MDX generation. After a bit more time though I felt more positive. For the power user it does pretty much everything that you’d ever want it to do, such as enter your own MDX, do writeback, advanced filtering, creating calculations; in fact it clearly does what every demanding customer has ever wanted it to do so it’s more than likely able to meet any obscure querying requirements you have.

I took my misgivings back to Panorama and they told me that the desktop client will be dropped in the next release, due Q1 2008, and from that point there will only be an AJAX-based zero-footprint client and a rich client based on Adobe Flex. It’s interesting that the latter is not based on .NET or even Silverlight; not only a move away from the desktop, which is only to be expected, but a move away from the Microsoft dev platform which I suppose makes sense given Panorama’s repositioning of itself away from being a purely Microsoft partner to working with SAP as well. Presumably it will have much the same capabilities as the current desktop client but look rather better… 

In the meantime, the comparison between Novaview Desktop and ProClarity Desktop is one that has been made a lot in the past and is probably worth making again. In terms of querying functionality they’re neck-and-neck but in my opinion Proclarity is easier to use and looks marginally better, although it is still falls way short of what I’d expect from a modern BI tool. The problem with the Proclarity Desktop tool is that is has it has been declared dead by Microsoft: the last official release was made late last year and it seems there’s no place for a rich client in the bright shiny web-enabled PerformancePoint future. I’ve heard various rumours about it such as that it was going to be turned into an Excel addin or, more recently that it was going to be rewritten in .NET, but that lack of any clear direction from Microsoft on its future is a bit frustrating. I suspect that Microsoft have decided that Excel is the only desktop tool anyone is going to need, but I think there’s still a role for a dedicated client for power users and I know a lot of other Proclarity users feel the same way. If you’re in the market for a full-featured AS desktop tool then there’s little point in going with Proclarity Desktop now, so Novaview wins by default given that there’s a clear roadmap for its future.

As far as the web-based querying and dashboarding functionality goes there is clear competition with what Panorama and PerformancePoint have to offer. A lot of companies will simply go with the Microsoft offering simply because it’s from Microsoft, and that’s a perfectly valid decision; anyway, given the lineage of the product it’s going to be a lot better than a typical Microsoft version 1.0. Why choose Panorama then? Panorama claim to be a lot more scaleable on the web than the old Proclarity equivalents; it’s probably too early to tell whether the same will be true of PerformancePoint though. The cross-platform capabilities will probably be the key: from what I’ve seen in my Analysis Services consultancy work, a lot of companies using AS also use SAP BW and a common front-end for both could be an enticing prospect. I’m also told that Panorama will be building functionality behind PerformancePoint to enable import of data from other platforms and in front of it to enable integration with other applications and business processes – the kind of value-add stuff that Microsoft can’t offer because of its longer release cycles and limitations on who they can partner with.

So, it looks like Panorama have got a future after all. Just as the Microsoft’s entry into the OLAP server market didn’t lead to the immediate bloodbath among rival OLAP vendors that many predicted, so its entry into the client tool market hasn’t (yet) killed off the old third-party client tools market. The delay in getting PerformancePoint released after the Proclarity acquisition and the fact that most companies are a long way from rolling Office 2007 onto their desktops means that companies like Panorama have had a chance to work out a survival strategy – and the choice this means can only be a good thing for us end users.

Metashare

Mark Garner has just dropped me a mail to let me know that Metashare, a tool he’s been working on for generating metadata documentation from SQL 2005 data warehouses and and SSIS packages, has just got to the beta 1 stage. Here’s his blog entry announcing this:

http://mgarner.wordpress.com/2007/07/27/metashare-beta-1/

…and you can find out more about it, and download it, from Sourceforge:

http://metashare.sourceforge.net/

PerformancePoint release date

David Francis has the scoop on the release date for PerformancePoint:
Apparently RTM will be sometime in September.