The first question to ask is whether it really matters. Shouldn’t a first class Records and Information Management (IM) program succeed by virtue of its own momentum and the value it creates irrespective of what the boxes on the org chart say? In a perfect world that would be true, but unfortunately we don’t live in a perfect world (if you need proof see my earlier post about the Calgary Flames missing the playoffs).

So where should the Records and Information Management function live? Not in IT, at least not in most cases.

Notwithstanding the fact that the “I” in “IT” stands for “Information”, the mandate of most IT organizations is to keep servers running and to manage vendor relationships. I know that many, if not most IT professionals are truly dedicated to helping their customers manage their business more efficiently, but at the end of the day the great majority of IT organizations are not set up to accommodate the challenges of managing information well.

And these challenges are many. Perhaps the most important comes from the fact that Information Management implementations do not have a natural beginning, middle and end. Information Management is an ongoing process that evolves and changes over time to support changing business requirements and the needs of their user community. Information Management is not a project and it certainly is not a technology deployment.

IT groups on the other hand generally operate a project management office tasked with standing up servers, upgrading software and rolling out new technologies. Each of these tasks fit well with a traditional “waterfall” project management methodology that expects right and wrong answers along the way. Information Management on the other hand is more art than science. Yes, it is critical that IM projects are managed properly and that appropriate controls are in place to ensure the implementation stays on track, but the key aspects of IM projects are people and process rather than technology. Change management is critically important and, let’s face it, most IT organizations are not adept at the people side of change.

That leaves the question of where the Records and IM function should live within your organization. In my experience there are three good answers depending on the makeup and business challenges of your organization.

1) If you are in a heavily regulated industry or are likely to face more than your fair share of lawsuits you likely want to align your IM program closely with your corporate legal group, reporting in to chief legal counsel.

2) If your objectives are to enhance operational efficiency or improve the bottom line of your business by managing your information better, align your IM program with an operational support area or even a strategic marketing or R&D group.

3) Finally, if you are in a situation where the only logical spot is within IT, try to ensure that you carve out the IM function from the other core teams in the IT group. One of my clients appointed a Director of Information Management a s a direct report of the CIO, which made her a peer of the more traditional IT roles of Infrastructure and Application support and gave her a seat at the table to advocate for IM.

In the end, when push comes to shove the core mandate of each part of your organization will ultimately prevail. In the case of IT, generally speaking their mandate is to keep the servers running and as a result the processes and political power tends to support this objective. Many IT groups can walk and chew gum at the same time but if they start to stumble they’ll spit out the gum before they fall over. Placing IM in a part of your organization where it can fulfil its mandate is one of the first steps on the road to success.

Cross-posted to the AIIM ERM Community blog.

In an earlier post I listed Eight Things SharePoint 2010 Needs to be a True ECM System, and, at first glance the new version looks very encouraging from an ECM perspective. As I’ve said before, I get excited by anything that can help my clients better manage their information and SharePoint has the potential to be a transformative platform bridging structured content, unstructured content and social computing in one flexible package. SharePoint 2007 does a decent job of this but it has some deficiencies when it comes to managing all content in the enterprise.

I’ll also give you the same caveat I gave last time; While this post focuses on SharePoint as a technology, technology is about the very last thing that should be considered when an organization sets out to manage its content more efficiently. Information management should start with a good business case, appropriate sponsorship, choosing the right areas of focus then building capacity within the organization to truly succeed. Technology is only the last piece of this puzzle. All of that said, there has been an incredible amount of interest in SharePoint (as illustrated by the 7,500 people who attended the SharePoint conference from October 19 to 22, 2009) and many of my clients have questions about where (or whether) this tool should fit into their ECM strategy.

Finally, the updates below are based on my attendance at the SharePoint conference where I went to as many breakout sessions as possible and chased down beleaguered Microsoft staffers to ask questions in what must have felt like a trip to the old Roman Coliseum (with the lions, not with Caesar). I tried to focus on attending ECM-specific sessions and have done as much reading as I can but as a vendor-neutral consultant Microsoft hasn’t seen fit to furnish C3 Associates with a pre-beta version of SharePoint 2010, so I haven’t actually used the system myself. As always we will continue to learn as much as we can about all of the ECM tools and technologies that are of interest to our clients but in the absence of actually working with SharePoint some of our understanding will be incomplete or possibly incorrect. I will provide updates in future posts as I learn more.

I have used a five point scale to evaluate the how well I think SharePoint 2010 meets my “Eight Things” criteria for inclusion into the ECM club. Remember that these are based on only my first look at the tool and are subject to revision as I learn more about how the new features and functions actually work.

Initial Ranking Scale

With all of that out of the way here are the eight reasons I think Microsoft has moved towards a more complete ECM solution.

1. Persistent links – The single biggest shortcoming of SharePoint 2007 is the inability to link directly to a unique object ID. One of the greatest benefits of ECM systems is the ability to send content via a link rather than relying on email attachments. In traditional ECM applications this isn’t a problem; each content object has its own unique ID that doesn’t change regardless of where it lives in the repository. In SharePoint 2007, links break if you rename or move a file. The other benefit of persistent linking is that it enables the management of compound documents (a container that stores multiple documents like the chapters of a book) and the ability to link directly to an older version of a document.

2. Store once, use many – SharePoint 2007 had a nasty habit of copying content throughout the system rather than using pointers to a single source of the truth (because content links might break as noted above). Perhaps the best example of the misguided use of “copy” capabilities in SharePoint is the “Send to…Records Center” feature where a copy of a document is sent to the Records Center while leaving the original in place rather than either moving the document and leaving a pointer or changing the state of the document to indicate its changed status (see point 3 for more on the RM capabilities of SharePoint).

3. Honest-to-goodness Records Management – I recognize that that SharePoint 2007 is DoD 5015.2 certified but the statement from the product development team that the DoD 5015.2 components are “not intended for customers…who would like to enhance the records management functionality of MOSS 2007 with particular 5015.2 oriented features but are not required to run their system in a certified configuration” doesn’t exactly inspire confidence. Add to this the fact that SharePoint doesn’t allow users to efficiently manage physical objects out of the box and it is clear that Microsoft needs to decide if they are really serious about the records management space or if they will leave it to partners.

4. Better metadata management – Metadata in SharePoint 2007 took a quantum leap forward with the introduction of Content Types. However, managing metadata in SharePoint 2007 can be difficult especially when dealing with multiple site collections.

5. Reusable search templates and stored search results – There is no question that search is a focus for Microsoft based on their acquisition of FAST and their push into public internet search with the recent launch of Bing. Search in SharePoint 2007 is reasonably good but the tool does not have the ability to either store a “snapshot” of search results for future reference nor does SharePoint 2007 allow users to create reusable search templates. This feature would save users time by allowing them to create a search query then either re-execute that query in the future or add new criteria without having to rebuild the entire search.

6. More granular security – This is one area where SharePoint was already reasonably strong but truly deep ECM systems include advanced security features like the ability to deny permission to certain objects on an as-needed basis. The current process for managing security is a bit cumbersome but I expect this is something Microsoft is working on. It will be interesting to see if what changes, if any, make it into the final release of the product.

7. Surface the audit trail – One of the things I like the best about established ECM applications is the ability to see who has opened my documents. I find this particularly handy on status report day when I inevitably discover that I’ve made a mistake in the document I’ve just sent out (as an unbreakable persistent link of course). I can check the audit trail to see if anyone has opened the document and if not, make my changes without anyone knowing I’d messed up in the first place. While SharePoint tracks most major audit events, the list of events is not as extensive as in a traditional ECM application nor is this information surfaced through the function menu of the content object.

8. More and more mature line-of-business integrations – This should be a strength of SharePoint given the sizeable .NET developer community as well as the extensive Microsoft partner ecosystem, but SharePoint still has a lot of catching up to do in this area. Organizations deploying SharePoint won’t be able to hold a single vendor to account for a series of modules (or Content Enabled Vertical Applications, as Gartner likes to call them). This may or may not be a bad thing depending on your perspective but established ECM vendors have offerings that satisfy a variety of industry verticals and business functions. To achieve the same thing with SharePoint customers will need to research, purchase and deploy modules from a variety of Microsoft partners. CMS Watch offers a good summary of the issues associated with third party add-ons for SharePoint.

To sum up, it is clear that SharePoint will continue to have a significant impact on the ECM landscape. The question is whether the functional improvements evident in SharePoint 2010 mean that organizations with significant commitments to other ECM platforms have to start all over again with SharePoint? In the short term, I think the answer is no. In many cases, the true benefit from the investments made in traditional ECM can be realized by surfacing some of this content though SharePoint interfaces; done well this can significantly enhance the user experience while still ensuring that the strong compliance engine in your existing ECM system keeps your content safe and your CEO out of jail.

I suspect that any changes in the ECM world will be evolutionary rather than revolutionary. SharePoint is a disruptive technology to be sure, but given it’s breadth, relative lack of maturity and a widely varied partner community Microsoft will help the overall ECM market grow and likely take established ECM vendors with it. As they (used to) say on Wall Street, a rising tide floats all boats.

This is not to say that things will be easy for the makes of FileNet, Documentum, Livelink and others; they have a significant challenge ahead in trying to position their products not relative to one another, but relative to SharePoint (whether they like it or not). The vendors that do this well will continue to thrive and any that choose to ignore SharePoint or do not recognize the significance of the changes in SharePoint 2010 could be in trouble.

As always I appreciate your feedback on anything you read here. Feel free to leave a comment here or drop me a note via my Twitter account at GregClarkC3.

I’m working on an update to my SharePoint 2010 post based on what I’ve learned since it was released in beta this fall. Look for that post early in new year. Until then, I wish all of my readers the best of the season and a fantastic 2010!

ECM is about managing information rather than just storing it. Done properly, it helps your organization take advantage of the vast amounts of information created every day by placing content in an appropriate context for your user community. This can mean pushing content out through a web portal or providing intuitive tools to allow users to create, browse or search for content when needed. The end result is that your organization will be both more efficient and more compliant with the rules that govern your industry because you will be able to retain information for as long as needed but no longer.

That strays a bit from the traditional definitions of ECM but I think that is kind of the point. It got me thinking about what I like about my job and why I got started on this crazy adventure in the first place. First off, I like ECM because I like people. The successful ECM implementations I have seen have not been implementations of a technology but have instead focused on efficiency, compliance, sharing and know-how; all of these things are influenced by the human beings in the mix and the technology is only a supporting player. Conversely, the ECM implementations I have seen that have not been as successful have been seen as technology rollouts.

The other thing I enjoy about ECM is that it allows me to work in a variety of different business areas. Although the focus of C3 Associates is on the energy, oil and gas industry there is an incredible diversity amongst the various business units in each of our clients. The opportunity to work with engineers in the morning, lawyers at lunch (because they’re busy the rest of the time) and accountants in the afternoon doesn’t come along very often. Each has their own unique perspective on the business of their organization and I see ECM as an opportunity to unite all of them to achieve more than they would have otherwise.

If helping people take their work to another level doesn’t get you out of bed in the morning, I don’t know what does.

You can download both slide decks in the Presentations section of our site.

Pankaj is one of the best project managers I have ever had the privilege of working with and this nomination is certainly well deserved. You can read more about Pankaj’s insights on project management at his Art and Science of Project Management blog.

We’ll be at the gala dinner on May 12th here in Calgary to cheer on Pankaj and all other award nominees. You can find out more about the event here.