Category Archives: Spin

Autodesk Cloud-based structural engineering software review

As I’ve already discussed, one of the areas where CAD on the Cloud shows potential is in handling specific tasks that require performing intensive calculations that are suitable for sharing among many processors. That sounds great in theory, and a lot of Cloud marketing (e.g. Virtually Infinite Computing) emphasises that point.

OK, that sounds promising, but how does it pan out in real life? One problem dissuading me from finding out is that Autodesk is being very restrictive with access to many of its Autodesk Cloud products (I’d probably throw a few sample render jobs into the Cloud and compare the performance, but I’m not the right kind of Subscription customer so I’m not allowed). Another problem is that I’m not qualified to review things like structural engineering software where the greatest computational potential appears to lie. Fortunately, Alex Bausk is qualified, so it was interesting to read his review of Autodesk’s Project Storm software.

It’s important to point out here that anything Autodesk with ‘Project’ in the name is not a finished product. It’s an Autodesk Labs thing, designed to attract feedback rather than use in production. I very much approve of this process. It’s one area in which I’m happy to endorse the way Autodesk is approaching the whole Cloud thing, and has several benefits over the flawed private Beta process that Autodesk uses for its mainstream products such as AutoCAD.

The downside for Autodesk when it comes to doing pre-release things publicly is that the criticism can be public, too. For example, selected from Alex’s review:

…the product is, for reasons unknown, available only in selected countries…

…utterly meaningless popups…

Options for analysis settings are, to put it short, appalling.

Project Storm is nothing more than a web envelope for our good old ARSA package. It is basically the same “Robot link” that reviteers have already had for quite a long time…

But the software’s practical use is extremely tiny, to the point of no use at all. You may surely forfeit all hope to do anything with it that would even remotely be relevant to all the “cloud analysis” hype in videos, intros and announcements.

I was unable to make any use of Storm with the sample models that come packed with Revit Structure and Robot Structural Analysis. To feed these default, Autodesk-made models to Storm, some really disruptive editing had to be made that involved deleting whole parts of the model, rendering it practically useless, only able to demonstrate how the process is meant to work.

Ouch! OK, so far it’s mainly just pointing out how half-baked the product is at this stage. Given that it’s a Project and not a finished product, that’s not so bad. It’s shipping products and features that are half-baked that I object to, and Autodesk has certainly produced a few of those. Anyway, here’s the bit I found particularly interesting:

Analysis speed, to a surprise, isn’t looking any good compared to desktop. The Storm’s cloud web analysis is extremely slow, likely because the server would yield a tiny fraction of its resources to your particular task.

In other words, the cloud speed and resource claim in case of Project Storm is no more than a standard cloud computing mantra.

…cloud calculations took around four minutes for this simple model, compared to fraction of a second using desktop…

What does this all mean? It could mean that Alex forgot to turn on the Ludicrous Speed toggle. It could mean that Autodesk is doing this experiment on the cheap and hasn’t paid for enough resources to make it work well. If so, that would be pretty short-sighted, and if Carl wants this Cloud thing to impress people he should sign off on a bunch more cash for Scott’s server farm budget. It could mean that this type of calculation is unsuited to parallel processing, in which case it’s probably not a great candidate for a Cloud product. Or it could mean that the calculation parts of this software haven’t been done properly yet, and everything will fly like the wind as soon as the developers get the hang of things.

Or maybe, just maybe, it means that the reality of Cloud computing isn’t quite as infinitely powerful as the hype makes out.

Is a CAD in the Cloud takeover inevitable?

One argument that CAD in the Cloud supporters sometimes make is that the Cloud is taking over regardless of what anybody thinks, so we might as well just embrace it and reap the benefits. Nice try, Nostradamus, but I’ve been around computers long enough to see many Next Big Things come to nothing and am thoroughly unconvinced by such attempts at self-fulfilling prophecy.

How inevitable is a CAD in the Cloud takeover, in terms of Cloud-based applications replacing traditional software? I’ve added a poll with a specific question about that, so it’s your turn to play soothsayer. What are the chances of you using a public Cloud-based application as your primary CAD software in 5 years? Please vote, and as always, your comments are welcome.

Autodesk Cloud – don’t panic, business as usual

Autodesk recently made a big announcement about its Cloud initiatives, and reactions have been all over the place. Some people can barely contain their breathless excitement while others are outraged to the point of passing out the pitchforks. Why? It’s pretty much business as usual.

It’s nothing like Dassault’s disastrous we’re-moving-you-to-the-Cloud FUD campaign against its own product, SolidWorks. There’s no hint here of AutoCAD (real AutoCAD, I mean, not “AutoCAD” WS) being moved to the Cloud, or anything as radical as that. (Yes, I know there’s a limited experiment along those lines but that’s nothing to do with this announcement). It’s just a collection of relatively minor changes to Autodesk’s existing on-line services, collected together to make a newsworthy press release.

(As an aside, I must say this was a much more worthwhile announcement than the ridiculously over-hyped DE8.16N thing. So I was supposed to get excited about a routine upgrade of a product I have already been using for months, on an OS I don’t use, when the upgraded product is still half-baked just like the first underwhelming effort? Fortunately, I didn’t get sucked in by the pre-announcement build-up so I wasn’t disappointed, just amused when the truth was revealed. Autodesk PR, please don’t cry wolf so often; keep the hype in reserve for the hypeworthy stuff.)

Back to the Cloud thing, and putting aside hype and horror, here’s the stuff that has just happened:

  • Autodesk Cloud documents lets anybody store up to 1 GB documents on-line, or 3 GB if you’re a Subscription customer. This isn’t new, but until recently it was an Autodesk Labs project called Nitrous. The infrastructure is provided via Amazon and Citrix.
  • AutoCAD WS has been updated to integrate its storage with Autodesk Cloud documents. Remember, WS isn’t anything like real AutoCAD, but rather a limited on-line DWG editing tool. There’s a WS iPhone app, but that’s not new.
  • There’s an Autodesk Design Review iPhone app for reviewing DWF files you’ve stored in Autodesk Cloud. It won’t do DWG; use WS for that.
  • There are several cloud-based services that are available “free” to Subscription-paying users of a small subset of Autodesk software, mostly Revit and Inventor-based suites. They are: 
    • Inventor Optimization
    • Cloud Rendering
    • Green Building Studio
    • Conceptual Energy Analysis
    • Buzzsaw (now bundled with Vault Subscription)

    AutoCAD users need not apply for any of these services.

So some of Autodesk’s on-line services are now being provided only to Subscription customers, and one is offered in improved form for Subscription customers. There are two obvious reasons for this: tie-in and revenue.

First, Autodesk wants its customers tied to the Subscription gravy train, if you’ll excuse a fairly awful mix of metaphors. Offering Subscription benefits like this is preferable to some of the much less pleasant arm-twisting that has been happening recently (e.g. trebling upgrade prices). Is it too much to hope that Autodesk has learned that offering carrots to its customers is a better strategy than threatening them with sticks?

Second, Autodesk needs to start making money out of this stuff somehow. For some years, it has spent several fortunes on buying and developing on-line services and then given them away for nothing, usually as Labs projects. This obviously can’t go on for ever, but just slapping a charge on these services wasn’t going to fly. Bundling Cloud services up with Subscription is a way of easing people into paying for them, and this is something I expect to be expanded in future, for example with AutoCAD WS. Once that’s been established for a few years, it wouldn’t surprise me to then see Subscription for at least some of the services split off, so you’re paying for Cloud services explicitly. By then, enough customers may consider them to be worth paying for and they may therefore survive beyond the short term.

Will it work? I’m not sure. Time will tell which of these services will thrive and which will die, and such uncertainty is one of the many reasons real-world customers aren’t excited about getting their heads in the Cloud. I don’t intend to make use of these services (I’m not even allowed to), so I’m not too bothered what happens to them. Like the vast majority of Autodesk customers, I will just carry on using conventional software in that old-fashioned 20th century way that just happens to work very well. Autodesk will go on providing its software in that way, because that’s what most customers will want for at least a while yet, and Autodesk can’t survive on wisps of Cloudy revenue.

Move along, people, nothing to see here.

Executive summary of Deelip’s AutoCAD for Mac interview

Deelip has just published an extensive interview with several Autodesk people about AutoCAD for the Mac. Deelip had a good set of questions and I suggest you read the whole thing, but if it’s all too tl;dr for you, then here is the lazy reader’s version of what Autodesk had to say:

  • The AutoCAD code was split up into 3 sections: the core CAD engine (platform-independent), the Windows-specific (MFC) parts and the Mac-specific (Cocoa) ones.
  • AutoCAD for Mac is incomplete. Choosing which features to leave out was done with the aid of CIP (oh, dear) and Beta feedback. (Hang on a minute, I thought CIP said most people were using the Ribbon…)
  • No comment on when or if AutoCAD for Mac functionality will catch up with its Windows counterpart.
  • No comment on the stability or performance of the Mac version.
  • Buying Visual Tau wasn’t a complete waste of money.
  • If Mac users want Windows-level functionality, they should use Bootcamp.
  • The Mac version is intended to expand the AutoCAD market to those Mac users who are frustrated by Bootcamp or who find it too hard.
  • Some mind-blowing spin was attempted in a valiant but vain attempt to explain away the Ribbon = productivity, Mac <> Ribbon marketing problem. You will really have to read it for yourself, as I can’t do it justice here. But “just because 2+2=4 doesn’t mean 4-2=2” will give you some idea of what to expect.
  • The Mac version is the same price as the Windows version, despite being incomplete, because Mac users won’t know or care about the missing stuff.
  • There are no plans for a Linux port, or any other platforms.
  • Autodesk will wait and see how AutoCAD for Mac does before porting any of the vertical products. (Very sensible).
  • Autodesk closed off the AutoCAD for Mac Beta program on announcement day because it wouldn’t have been able to cope with the mass of feedback from new users.
  • Autodesk will not allow dual use (Windows + Mac) licenses. If you want to have both products available to you, you will need to buy the software twice.
  • You can cross-grade AutoCAD from Windows to Mac for a nominal fee, or for nothing extra if you upgrade at the same time. (Although at 50% of the retail price of a whole new license, such an upgrade hardly represents a bargain).
  • Autodesk really doesn’t have any idea what is going to happen in the Mac CAD marketplace. (Refreshingly honest).
  • Little comment on why AutoCAD WS is called AutoCAD, other than iOs users not expecting their apps to do much anyway, plus it’s “part of the AutoCAD family.”
  • WS doesn’t stand for anything.

iPad, iPhone app – good and bad news

Good news! Autodesk has announced an app that will link iPads and iPhones to Project Butterfly. This provides viewing, markup and limited editing facilities.

Bad news! Autodesk has decide to call it AutoCAD WS, which is bordering on the fraudulent. It’s not AutoCAD, is nothing like it, and is unlikely to ever be anything like it. I can call my dog Prince, but that doesn’t make him royalty. Unfortunately, much of the mainstream media appears to be blissfully unaware of this. This is gaining Autodesk some short-term column inches, but at the longer-term expense of furthering the myth that “AutoCAD” is going to run on iPhone and iPads. People will start using Butterfly, think it’s AutoCAD, and then, if they need CAD for their Macs, wonder why they should spend thousands on something so basic and limited.

Good news! It will be available Real Soon Now, and you can sign up for it at http://butterfly.autodesk.com/mobile/.

Bad news! You can’t sign up for it using your iPhone or iPad (unless it’s jailbroken). Apple may be convinced you don’t need Flash, but Autodesk disagrees. The Butterfly signup page requires Flash, you see. It wants to send you off to adobe.com.

Ouch! You have to admit, that’s pretty funny. Cluelessness? There’s an app for that. I guess iUsers will just have to use their Macbook Pros to sign up.

AutoCAD for Mac – what’s missing?

According to Autodesk, the forthcoming OS X version of AutoCAD has “many of the powerful AutoCAD features and functionality.” So what doesn’t it have? What are the holes? Autodesk hasn’t bothered to let me know a single thing about this software, so I guess I’ll just indulge in some irresponsible and uninformed speculation, based on what I can glean from marketing materials and various better-informed sources. I could have just asked, but who knows if I would have ever got any real answers? Besides, this way is more fun.

First, here’s a quick list of some things that don’t appear to be missing, but which might have been lost in translation:

  • Command line (in fact, the Mac one appears to be better than the Windows one).
  • Xrefs.
  • 3D, including visual styles and rendering.
  • Some kind of Quick View Layouts and/or Drawings feature.
  • Navcube.
  • Constraints.
  • Dynamic Input.
  • Selection highlighting.
  • LISP (at least some form of it).

Now for speculation on things that are possibly missing or not fully functional (based largely on screenshots, which is not a reliable indicator):

  • I don’t see a Communications Center, but I do see an Online Contact pull-down. Maybe that gives access to the same functionality, maybe it doesn’t.
  • Navbar.
  • Coordinate display in status bar.
  • Layout tabs (there’s a control instead)
  • The layer palette, in its docked form as shown in screenshots, looks very cut-down and would be tricky to use productively in complex drawings. It’s not clear if the old layer dialogue box is supported, but it needs to be.
  • Action Recorder? As this is a “brochure feature”, it’s no great loss if it’s absent.
  • Visual LISP? It’s not mentioned, so maybe it’s missing, or lacking the ActiveX bits. That would be a big problem for many organisations. Edit: I have since seen it confirmed that the Visual LISP environment is missing, as are the COM APIs.
  • Other APIs? DCL? ActiveARX? Deelip’s developing stuff using something, but the blurb just mentions a “flexible development platform” without giving any indication of what that means. Which leads to…
  • Add-ons, large and small. Many of us use various third-party utilities for making our AutoCAD lives more productive. Will they work? Probably not. Can the developer make them work? Maybe. But only if they want to, and feel the need to make the investments required. For small developers, that may not be the case.
  • Will your tablet, image and screen menus work in this environment? I don’t know, but here’s a guess: no.
  • Profiles? I couldn’t possibly work without being able to store and switch between profiles.
  • Object enablers. Has it got a full set? Or any at all? Dunno, but Autodesk’s object support for DWGs from its own AutoCAD verticals has been patchy, even on Windows.
  • Performance. Has it got any? Dunno.
  • Reliability. Has it got any? Dunno.
  • Longevity. Has it got any? Dunno. I think we can confidently expect an AutoCAD for Mac 2012, and probably 2013 too. Beyond that, it’s anyone’s guess. Maybe I should run a book on it?

Finally, things that do appear to missing:

  • Ribbon, QAT and The Big Red A. What, no Next Big Thing in UI Design, embraced wholeheartedly by Autodesk from AutoCAD 2009 onwards and still spreading out to the outer reaches of the product range? How will Mac users be able to live with the terrible loss of productivity when compared with their Windows-using colleagues?
  • CUI. There is a screenshot of a very cut-down interface customisation thing, but it’s not the CUI interface you’ve grown to love. Seriously, it looks extremely limited.
  • Express Tools. Last time Autodesk tried to sell an AutoCAD without these was 2000i. Remember that? Maybe not, because the i apparently stood for ignore and upgraders avoided it in droves.
  • AutoCAD verticals. Civil 3D for Mac, anyone? Mechanical? Architecture? Not yet. Verticals, if they ever arrive, are likely to be years away.
  • Network licensing. All of your Macs will need individial licenses.

It will be amusing to see how the various omissions are spun or glossed over. My guess is that they will be ignored altogether, or some vague indication being given to them being investigated for possible inclusion in a future release. But maybe you can think of more interesting ways of handling it. How about something like this for the missing Ribbon?

Mac, Windows. Chalk, Cheese. Ribbon, no Ribbon. Oil, Water. Creative, Productive. Cat, Dog. Trendy, Nerdy. Choose one. Be whatever you want to be. Because with AutoCAD®, it’s your choice™.

Have a go with your own Spin Segment. Who knows? Autodesk may even use your ideas.

More Autodesk deception over LT productivity study

Following on from the AutoCAD 2011 productivity study I critiqued earlier, there is now an LT version. Do the same credibility problems apply to this study too? Yes, and then some.

In addition to the drawings and operations being deliberately hand-picked to demonstrate new features, no direct comparison is performed at all between the two releases on the same platforms. Every single quoted “productivity improvement” figure includes, free of charge, three years of hardware and operating system progress and a more upmarket graphics card.

If you read business “news” sources that just reprint press releases, such as this Yahoo! Finance one (thanks, Carol Bartz), you won’t see this mentioned. Instead, you will see deceptive statements like these:

David S. Cohn, an independent consultant

Er, no, in this context he’s not independent, he’s an Autodesk consultant. Not that there’s anything wrong with that.

overall productivity gains of 44 percent for users moving from AutoCAD LT 2008 or earlier versions to AutoCAD LT 2011

…as long as you only ever perform certain carefully selected operations and upgrade your hardware and operating system. Like the other study, the 44% figure is totally meaningless and quoting it without qualification is downright deceptive.

Most users will be able to get more work done faster by upgrading to AutoCAD LT 2011

This statement is totally unsupported. There is no analysis of what “most users” do with the software, and no attempt to quantify the portion of time such users spend on these hand-picked operations. Neither is there any analysis performed on more common operations to see if the new releases introduced any detriment to productivity in those areas.

Improvements to the graphical user interface deliver a 43 percent productivity increase.

If that’s true, why do so many users of 2009 to 2011 immediately turn off the new user interface? Are they all stupid Luddites who have a burning desire to work much less efficiently? This study, like its non-LT counterpart, contains many unqualified statements about the Ribbon improving productivity and providing other benefits. I’d really like to see a proper independent study done into that.

To sum up, Autodesk is quite prepared to say misleading stuff about its products that will be regurgitated unquestioningly by those who don’t know any better, in the hope that it will be believed by those who do, and not exposed by those who care. But it’s not prepared to answer straightforward legitimate questions about its business, offering a pile of spin instead. This, supposedly because “management in publicly trade companies are forbidden by US laws and accounting regulations to discuss some topics”.

I think I’ll borrow a phrase from Deelip here, as it seems appropriate.

Bottom line. This is bullshit.

It just so happens that right now I’m in a no-bullshit mood. I’ve been exposed to more than enough of it lately. Unfortunate timing, Autodesk.

I know this sort of marketing device is nothing new, and maybe that’s the point. This kind of thing is so 20th century. In the good old days, negative commentary about stuff like this would be seen by few, and largely confined to company-controlled environments and one-way media such as printed magazines. Things aren’t like that any more. This sort of nonsense is being increasingly noticed, criticised and derided in blogs and social media. I have hope that the point will soon come when companies’ PR consultants work out that the negatives of spewing bullshit outweigh the positives. When that point is reached, the bullshit will stop. And won’t that be great?

Not answering the question

Here in Australia, we’re in election mode, so I have even more reasons to avoid watching TV. On those occasions when I do watch it, I am often annoyed by what I see. This is not a novel observation, but one of the things that annoys me about many politicians is their habit of sidestepping questions when interviewed. It also annoys me when interviewers fail to follow up these non-answers and let them slide. Depending on the circumstances (e.g. limited timeframe, more important questions to ask, etc.), there may be valid reasons for journalists failing to chase after legitimate answers in a live interview situation. But I would much prefer to see a non-answering interviewee tied down and not allowed to wriggle free. Squirm, baby, squirm!

For on-line journalists and bloggers, there are few excuses for letting non-answers go unchallenged. There is virtually unlimited time, opportunity and column space in which things can be chased down. With that in mind, this post is an analysis of the response Callan Carpenter gave to the four specific questions I raised, and three points of dispute raised by others and passed on by me for a response. I have marked each response (or non-response) out of 10.

Questions

Please clarify in as much detail as possible exactly how you arrive at your figures.

Answer: none given. 0/10

A percentage is derived by dividing one number by another; what exactly are you dividing by what to come up with 1.5%?

Answer: none given. 0/10

Please explain why your statements appear to contradict Autodesk’s own published figures.

Answer: Callan explained that he did not intend to suggest what it seemed he was implying, but didn’t clearly explain exactly what it was that he actually was suggesting. 5/10

How large is Autodesk’s total installed base?

Answer: none given. 0/10

Points of dispute

Because Autodesk made Subscription cheaper than upgrading, it is no surprise that upgrading became less popular. This doesn’t indicate that customers prefer doing business in that way, merely that Autodesk made it the cheapest alternative.

Response: this statement was pretty much repeated back as if it were an answer: “the majority of customers buying over the past few years have opted to leverage the Subscription program…the most cost effective way possible”. 1/10

If the idea of Subscription is such an attractive proposition, why do you need to sweeten the deal with tools that you don’t allow upgraders to have?

Response: this statement was also pretty much repeated back as if it were an answer: “…there is much more to the program than cost savings…just some of the value-added aspects of the program”. 1/10

Your assertion that the 12-month cycle is driven by the product teams is incorrect. It was chosen for business reasons and the product cycle was forced to fit the Subscription model.

Response: none given. 0/10

Overall “answering the question” mark: 7/70 or 10%.

Callan, thanks for taking some time out of your busy schedule to provide some kind of a response. If you want to have another bite at the cherry and actually answer what you’ve been asked this time, you are welcome to do so. You know where to find me.

Readers, am I being too harsh here?

Studying Autodesk’s productivity study

Heidi Hewett just reported the following on her blog, about a productivity study:

According to a recent independent study, AutoCAD® 2011 can help you work up to 44% faster with the latest productivity enhancements.

I have a couple of problems with that sentence. First, it’s not an independent study. It’s a study conducted by long-time respected CAD figure David Cohn, but it was specified and paid for by Autodesk:

This productivity study was performed at the request of Autodesk Inc., which funded this work.

That’s not exactly independent then, is it? Second, the study does not state that AutoCAD 2011 is responsible for a 44% improvement. That’s a figure that combines both the effects of AutoCAD 2011 (over AutoCAD 2008), plus the effects of using a newer, faster PC. Just stating that figure wthout such a disclaimer is misleading.

Now to the study itself. Let me make it clear that I have no problem with David Cohn, who is respected, experienced and honest. I do not doubt that his study accurately describes his observations of the time taken to perform the chosen operations on the chosen drawings. The problem is that the study is designed to concentrate purely on a set of AutoCAD operations that benefit from the changes of the last three releases. In other words, the dice are very heavily loaded. To David’s credit, he states that very clearly in the study report:

Each drawing was chosen based on a number of criteria designed to showcase one or more features of the software that did not exist in AutoCAD 2008 but were added in subsequent releases. While each drawing could certainly be produced using the features and functions available in AutoCAD 2008, the advanced capabilities added in subsequent releases would likely enable a typical user to produce the drawing faster using AutoCAD 2011.

Since the premise of the test was to determine how much time could be saved by using a new feature, the test itself was already predisposed to show that using AutoCAD 2011 is more productive than using AutoCAD 2008.

A quick skim-read shows that there are several other problems with the study. For example, it doesn’t attempt to measure the productivity of those operations that are common to both releases, which are much more likely to be used in bulk by typical users. The report states that the Ribbon interface is likely to be more productive, but makes no attempt to justify that by comparing the exact same operations performed using the two interfaces.

In addition, both AutoCAD 2008 and 2011 are measured on a typical middle-age PC using XP, but only 2011 is measured on a modern PC running Windows 7. The report states that the latter tests were performed after the former tests, so the times will also be biased by familiarity with AutoCAD 2011, the drawings and the operations required. That’s where the 44% figure comes from, and it doesn’t mean anything.

What’s the point of studies like this, that are self-evidently designed to produce a good-looking outcome? Who are they supposed to fool?  Come on Autodesk, either do these things properly or don’t do them at all. Please.

Censorship on the Autodesk discussion groups

The Autodesk discussion groups have quite a few problems at the moment, which I will discuss at length in future. One unnecessary problem that has been added to the mix is censorship. Having praised Autodesk in the past for allowing discussion to go unhindered, it’s only fair to slam heavy-handed moderation when I see it.

Before I get started, let me just say that Autodesk is entitled to moderate its discussion groups as it sees fit. The forum belongs to Autodesk and it can do what it likes with it. But just because Autodesk can censor its forums, that doesn’t mean it’s always a good idea to do so. Neither does that it mean that Autodesk is immune to public criticism of that censorship. There is no First Amendment obligation on Autodesk, but there are many other places that censored viewpoints can be repeated. Here, for example.

In this particular case, a section was deleted from a reply I made in a thread about the educational plot stamp. In that section, I mentioned that the educational plot stamp is very easy to remove with an everyday AutoCAD command. I didn’t name that command or give any details of how to use it to remove the stamp.

Now I understand that Autodesk gets the twitches when people discuss circumvention of its educational stamp “virus”, but I didn’t mention anything that isn’t already public knowledge. I discussed this issue at length in Cadalyst some five years ago, again without giving away the details. If you really want to know the details, please don’t ask me because I won’t reply. Google it, it’s out there. You probably don’t even need to do that. It’s a pretty obvious thing to attempt. It was, in fact, the very first thing I tried when I first saw an example of an infected file. It worked perfectly.

Back to the censorship. My post was edited, and I wasn’t happy. I wasn’t contacted about it, so it was not possible to have a reasoned discussion about it with the moderator (as I have done in the past on the AUGI forums and elsewhere). Annoyed, I made a further post, this one objecting to the censorship. In that post, among other things, I pointed out that the Autodesk position on the plot stamp was fictional. Here is what the Autodesk knowledge base item TS63668 (which I can no longer find) had to say on the subject:

Issue
When you plot a drawing that was created in or that contains drawing data that was created in the Educational (Student and Faculty) version of AutoCAD® or AutoCAD-based software, the following plot stamp or watermark appears in the plot:

For Educational Use Only

Solution

There is no way to circumvent the plot stamp. This is as designed to discourage the commercial use of an educational version of an AutoCAD product. Autodesk sells educational versions of software on the premise that the software will be used for educational purposes only.

The statement above in italics is a blatant lie. Hopefully, the knowledge base item is now missing because somebody sensible at Autodesk decided that it’s not a good look to have such fraudulent nonsense on its site, dishonestly masquerading as technical support. Or maybe it’s not missing but I can’t find it because the search engine is bad. After all, Autodesk really, really sucks at search. Perhaps it should buy a search engine company?

I digress; back to the censorship issue again. My post objecting to the first censorship was deleted. I was not contacted to discuss this deletion. I made another post objecting to the second censorship of my objection to the first censorship. This post made no reference whatsoever to the plot stamp issue itself. This post was deleted, too. In a surprise development, I was not contacted to discuss this deletion. Three levels of censorship to cover up an Autodesk lie. I can’t see a problem with that, can you? Except for this:

The Internet interprets censorship as damage and routes around it. — John Gilmore

Discussion_Admin, you were entirely within your rights to perform this censorship. Your moderation guidelines may even require it. But as a result, my statement about the plot stamp being easily removed has been read by a much larger number of people. So it really wasn’t such a good idea to censor it, was it?

Readers, if you have your own Autodesk censorship tales to tell, feel free to tell them here. It should be a fun read.

What proportion of Autodesk customers really are on Subscription?

In my recent interview of Autodesk Subscription VP Callan Carpenter, he made these statements:

…there is a very small fraction of our revenue that comes from upgrades at this point in time.

We’re down to very low single digits of customers who upgrade, and of those only half of those upgrade 1 or 2 years back. So we’re talking about approximately 1.5% of our revenue that comes from customers upgrading 1 and 2 versions back.

…[customers who upgrade] 1 or 2 [releases] back, a very small percentage of our customer base, less than 2% of our customer base that was buying those upgrades.

Others are calling those numbers into doubt. Deelip Menezes (SYCODE, Print 3D) estimated the numbers of AutoCAD users not on Subscription at 66% (or 43%, depending on which bit of the post you read), by counting the AutoCAD releases used by his customers and making assumptions about their Subscription status from that. That’s an extremely suspect methodology, as I pointed out:

Your numbers don’t really tell us anything about Subscription v. upgrade proportions. All they tell us is that large numbers of people wait a while before installing a new release. We all knew that, surely.

However, Deelip’s post did prompt me to point out this:

…there is a fair point to be made about people on earlier releases who have hopped off the upgrade train altogether, or at least for a significant number of years. How would they be counted in Callan’s figures? They wouldn’t exist at all, as far as his income percentages are concerned.

Owen Wengerd (ManuSoft, CADLock) asked a random sample of his customers and came up with 82% of them as non-Subscription customers. He also noted that he could come up with a 3% non-Subscription figure if he cooked the books by selectively choosing a convenient time slice. Owen doesn’t state the numbers in his sample, or indicate (or know) how many of the non-Subscribers are also non-upgraders.

I’ve added my own poll (see right) just to add to the mix.

Nothing we can hang a conclusion on yet, then. But Ralph Grabowski (WorldCAD Access, upFront.eZine) uses Autodesk’s own figures to point out that upgrade revenue has increased 18% and Subscription revenue only 7% in the last year. I’m not qualified to perform an analysis of the 2011 Q1 fiscal results, but I can find the figures listed as Maintenance revenue ($195 M) and Upgrade revenue ($51 M). That looks to me like about 21% of the Subscription/upgrade income is coming from upgrades.

Also, according to the published figures, Autodesk has 2,383,000 customers on Subscription. If that represents about 97% of customers, does that really mean Autodesk has only about 2.5 M customers? If I’m looking at these figures in the wrong way, feel free to put me right.

So, what’s the truth? What proportion of Autodesk customers really are on Subscription? 3%? 21%? 43%? 66%? 82%? I’m going to ask Callan a follow-up question about this and will report back on what he has to say. In the spirit of this post, I’ll be asking him for a lot more detail. Watch this space.

Does Autodesk discuss future plans?

According to Shaan, Autodesk does not discuss its future plans. Or does it? In a comment, Ralph reckoned it does. Putting aside technology previews and various NDA-bound circumstances (e.g. Beta testing), can you think of cases where Autodesk has revealed what it intends to do in future? Here are a few off the top of my head:

  • I’ve been to AU sessions dating back to 1995 that pretty much give away the contents of the next release of AutoCAD, using a vague cover-my-butt session title and a disclaimer at the start of the session. I understand that these days, attendees need to sign an NDA before entering such sessions.
  • Last year in San Francisco, an international blogger audience was given all sorts of information about Autodesk’s future directions (preceded by a similar disclaimer), with no NDA and nothing off the record. I assume something similar happened at this year’s North American bloggers’ event.
  • The Subscription (Advantage) Packs of the last couple of years have been a dead giveaway about some of the features that are going to make their way into the next release.
  • The new 50%-cost upgrade policy was announced a year in advance.
  • Surveys and other customer feedback mechanisms provide a very big clue about what Autodesk is looking at changing next. Some of these are covered by NDA, others are not.
  • In the specific case that triggered this discussion, Autodesk has been gradually building up expectation of a Mac AutoCAD for quite a while. Yes, it required a little reading Between the Lines, but for some time it has been pretty obvious where all the Mac love was leading to.

Feel free to add your own examples, but it seems to me that Autodesk is perfectly happy to reveal future plans as and when it sees fit. And that’s fine. In each of the above cases, the revelations have been A Good Thing. Good for Autodesk, good for customers.

Maybe the question should be, “Why doesn’t Autodesk discuss future plans much more often?” Stock market regulations, perhaps? But hang on, there are some very major publicly traded corporations that seem to get away with revealing all sorts of things about their future products. For example, Microsoft regularly conducts very widespread public Beta programs that let people know in great detail what’s very likely to appear in the next release, and seems to have survived the experience so far. There’s surely no reason why Autodesk couldn’t do the same if it wanted to.

Ultimately, it comes down to a desire for secrecy; a culture of concealment and control. Of course Autodesk may have legitimate reasons for keeping some of its plans from its competitors, but the culture can be so pervasive as to cause some bizarre side effects. You may find this difficult to comprehend, but there are those in Autodesk who got into a tizzy about me speculating in my launch announcement that Autodesk’s general design product (AutoCAD 2010) was going to be followed by something called AutoCAD 2011. There was something of a surreal drama behind the scenes. There were apparently people within Autodesk who genuinely thought I needed privileged information to work out that 10+1=11. No, I’m not making this up.

I’m not sure Autodesk’s secrecy is doing any good for anyone. It’s surely harder to maintain these days and it’s only going to get harder. I suspect several Autodesk blood vessels were burst when AutoCAD Mac Beta 1 was leaked. On the one hand, I can understand that; somebody broke an NDA, a legitimate agreement was freely entered into and then broken. Some people at Autodesk probably had their carefully planned marketing timelines disrupted.

On the other hand, this provided a whole heap of free and largely positive publicity. Potential AutoCAD for Mac users are now hovering in anticipation, filling the Mac forums, spreading the good news among themselves, putting off the purchase of competitive products, considering entering the official Beta program, and so on. At the same time, the news of performance issues in the early Beta is helping to put a dampener on expectations in that area. Lowered customer expectations may turn out to be very useful when the product is actually released. All considered, a good thing for Autodesk, then.

I’m convinced that Autodesk is opening up. That’s great, but there’s a way to go yet.

Callan Carpenter interview 3 – the cost of complexity

Part 3 of 5 in this series.

SJ: In one of my blog posts, I was pretty cynical about one of the phrases used in the press release: “the streamlining of upgrade pricing based on feedback from customers and resellers”. Was I wrong to be cynical about that? Did your customers really ask for upgrade prices to be increased to some nice round number?

CC: What our customers have asked for is simplified purchasing. We have a very complex price book and it leads to thousands of prices items, maybe tens of thousands when you have all the permutations across all the different geographies in which we sell software. A lot of that complexity came from having multiple-step upgrades, multiple-step crossgrades. There is a cost to maintaining that kind of a system. So our resellers certainly were asking for simplification and streamlining explicitly. Our customers were asking to find ways to make it easier to do business with Autodesk; can it be less expensive? One of the costs of doing business is maintaining a very complex pricing scheme as we have in the past. So while we may not have a customer say, “Gosh, I wish you would simplify your upgrade pricing” explicitly, it is implicit in trying to offer an easier path to buying and less cost in the long run because we’re not maintaining a very complex system that only serves a very small percentage of our customer base.

SJ: So there’s a real cost associated with this. Can you put a number on that as a percentage of the cost of the upgrade? Is it 1%? 10%? Is a big amount that customers need to be worried about?

CC: You know, I’ve never tried to put it as a percentage of the cost of an upgrade and tried to figure it out. Some of these things are a little difficult to untangle, but you can look at the complexity of your back office software, the staff that it takes to maintain it, the cost of the releases; our customers are simply aware of our releases of our software products, but they’re not aware of the fact that of course we have numerous releases of our internal systems for tracking and matching assets, price books, things like this. All of those have a cost associated with them. People, software, systems and so on. I haven’t ever tried to calculate that as a percentage of the cost of an upgrade, but it’s certainly a real cost nonetheless.

SJ: So let’s say it was costing people 5%. Why didn’t you reduce the prices by 5% instead of trebling them?

CC: Well, we didn’t really treble the prices. What we did was we said, remember for 3 or more versions back, the price is essentially unchanged. It may be a couple of hundred dollars more expensive or less expensive depending on the product and the market for the third version back. The big change was really in 1 or 2 back, a very small percentage of our customer base, less than 2% of our customer base that was buying those upgrades. It didn’t really make sense to us to maintain the complexity for that small percentage of our customer base.

I think that it’s an interesting point that we’re in because if you go back far enough in time, and you don’t have to go back that far, about 8 or 9 years I guess, with Subscription we could have been arguing the other extreme. We could have been arguing that, “My goodness, why are you making me pay for upgrades?”, and this Subscription thing either didn’t exist or it was very, very expensive. And then we designed Subscription to actually be very cost-effective, to be the most cost-effective to get access to this technology. So it’s an interesting inversion. I think it would be an interesting mind-experiment to wonder what would happen if we took away our Subscription pricing tomorrow, which is typically somewhere between 10% and 18% of list price of the product, depending on the product and the market. If we took that option away tomorrow, I think we actually would create tremendous havoc in the marketplace, because that’s really where the majority of our customers are today in terms of buying our software.

SJ: There are people who do still want to buy upgrades, those who want to have that choice. Do you understand the mindset of people who say, “I want to see what the product is before I pay for it”?

CC: I can appreciate that sentiment. I’d like to believe that our 25+ years of history has generally shown that our pace of advancement is generally up and to the right. Certainly there have been hiccups along the way; some releases have more functionality than others, but generally it’s up and to the right. But the customers who wish to do that, I certainly can appreciate that and that’s as good a reason as any for why we’ve kept upgrade and Subscription pricing as opposed to one or the other, because it gives customers a choice. For those customers who tend to want to wait and see, again the vast majority of them are doing it 3 or more versions back. If they’re doing it less than that, they’re on Subscription, by and large. So they still have that option. Even with the simplified upgrade pricing, I think it’s important to point out that we announced it over a year ago, and even today, if a customer goes off Subscription, they have up to a year to retroactively attach it. So the hope is with that timeframe, questions of, “Is the economy going to turn back up?”, those sort of things will be answered. If it takes 2 years for those questions to be answered, well then you’re back to 3 versions back pricing or more, and that has hardly changed, if at all. So I think that those kind of customers that want to wait and see what the product is going to be before they buy it, they have that option.

You have to also realise that there are also other benefits that come from Subscription in addition to the upgrade. Access to our product support teams, access to prior version usage, home use licenses, the prerequisite to global floating network licenses and other types of benefits, those are a very significant proportion of the value.

See also
Callan Carpenter interview 1 – Autodesk and social media
Callan Carpenter interview 2 – upgrades a tiny minority

The Machine that Won the War

I just wanted to get on the record that I don’t trust claims based on statistical data without being able to review in detail the methods used to obtain and interpret the data. Even with the best intentions, full integrity and honesty, it is not difficult to come to completely the wrong conclusions based on apparently compelling statistical evidence.

This isn’t just theory, I’ve seen it happen. Detailed percentages presented at upper governmental levels, based on huge sample sets, giving a totally false impression because of errors and assumptions that occur at various places in the process. The exact same question asked twice in the same survey, giving very different results depending on the section in which the question appeared, providing an unstated context to the question. The devil is in the details, and the details can be extremely subtle.

I have a “put up or shut up” rule that applies to anybody who makes claims based on unrevealed statistical evidence. It applies to corporations, news outlets, bloggers, government ministers, everybody. Without allowing scrutiny of the full details, all statistical claims are null and void, as far as I’m concerned. “Trust me” doesn’t cut it. Sorry, no exceptions.

What does this have to do with the title? Those familiar with Isaac Asimov’s short story of that name will understand. I’m sure Robin Capper worked it out immediately.

Command line poll replaced

For the past couple of months, I have been running a poll about the command line. I ran it using wording copied directly from a Project Butterfly poll, to get some kind of comparison between the poll respondents on this blog and those on the Project Butterfly blog.

It’s fair to say that I don’t like the wording of the available options, which appear designed to influence the result rather than find out what people really think. The “I can’t work with…” option has negative connotations; if I pick this choice, it implies that my abilities fall short in some way and I lack flexibility. On the other hand, the “I think it’s time for a new way…” option has a positive feel about it. If I pick this choice, I’m a thinker, I’m progressive, I’m looking to the future. It’s no accident that marketing people love to plaster “NEW!” over their products.

Despite the push-poll options, the command line was the clear winner on both blogs. Here are the Project Butterfly results (unknown number of voters):

I can’t work without the command line (66%)
I think it’s time for a new way to draw without the command line (34%)

Here are my results (378 voters):

I can’t work without the command line (81.7%)
I think it’s time for a new way to draw without the command line (18.3%)

I expected to see a greater preference for the command line among readers of this blog (largely command-line-using AutoCAD users) than among readers of the Project Butterfly blog (largely command-line-less Project Butterfly users). My expectation has been met. Instead of about a 2:1 majority there, command-line people here have about a 4.5:1 majority.

Now let’s try a similar poll, hopefully without biased options, and see if that affects the result. I have replaced the above poll with this one:

Should CAD software have a command line?

Yes
No

There are several ways in which this question could have been asked (do you prefer, is it more efficient, is it better, etc.), but the above appears to be the least biased I can come up with. Please have a look at this and other polls over on the right and vote if you feel so moved.

It’s not easy being green (and believed)

I know that some of you out there (unlike me) are pretty cynical about anything that Autodesk says on any subject. So when Autodesk makes a big thing about being environmentally responsible, such as its new Autodesk Sustainable Design Center site, it would be tempting to say “Yeah, right” and assume it’s just more spin to ignore.

That would be wrong. Yes, Autodesk is using its green credentials as a marketing tool. No, that doesn’t mean it’s all bovine excrement. Autodesk is genuine about this stuff. It’s being driven from the top, and it’s being driven hard.

How do I know? In addition to Autodesk backing up its assertions with a reasonable level of detail and independent scrutiny, I have a little first-hand knowledge. When I was attending the AutoCAD 2010 launch bloggers’ event last year, I was able to chat casually with quite a few non-marketing people. During those conversations, Autodesk’s move towards green issues was mentioned by more than one person, and in unscripted ways. It was clear to me that Carl Bass was serious about this and was strongly pushing a green culture within the company.

Disclosure: when attending the AutoCAD 2010 launch in February 2009, Autodesk provided transport, accommodation and some meals. Yes, I am fully aware of the irony of learning about Autodesk’s green culture only because it flew me half way round the world and back again.

Autodesk Subscription – it could be worse

I’m still looking for your questions about Autodesk Subscription and upgrade policies and pricing. No matter what you think about that, you have to admit that Autodesk’s current policies are less anti-customer than those inflicted on SolidWorks users.

Disallowing bug fixes for non-subscription customers is reprehensible, no matter what kind of spin is put on it. Not only that, it’s clueless. So you’re annoyed at Autodesk for whatever reason and are looking for alternative software from a company that doesn’t mistreat its customers? You know not to even bother looking at SolidWorks, don’t you?

Edit: more relevant links and customer comments from Devon Sowell and Matt Lombard’s blogs.

Some meaningless AutoCAD 2011 numbers

According to David Cohn, at yesterday’s blogger event in San Fransisco prior to the 2011 launch, Autodesk provided the following figures:

  • 76,000 man hours spent on Q/A of the new release
  • 6,000 total code reviews of new release
  • 2,000 commands tested
  • 4,600 Beta customers involved in AutoCAD 2011
  • 1.4M lines of old code were removed

Well, that’s all very nice, but those numbers are completely meaningless without context. Autodesk may as well have just published the equivalent numbers for Release 13; I’m sure they would have looked impressive in isolation.

Did anybody in the blogger audience ask the obvious question?

How do these numbers compare with previous releases?

If so, I’d be interested to see the answer.

If not, why not? I’d like to think that I would have asked such a question rather than sitting there unquestionably accepting whatever was being presented.

I’d like to think that, but I can’t. I’m in no position to throw stones. I had a similar opportunity at the equivalent event last year and failed to take advantage of it. I was operating at a very sub-optimal level for a variety of reasons (some of which were entirely of my own making, so no excuses there). It was a small, fairly informal event at which Autodesk actively and repeatedly encouraged two-way communication. But sitting there absorbing what I was told was pretty much all I did. I even caught myself on video doing this (i.e. very little), so I have absolutely no right to expect anything better from anyone else this year.

Still, it would have been nice to have had that question asked. It would be even nicer to have it answered. Otherwise, the numbers will remain meaningless.

Can you work without a command line?

On the Project Butterfly blog, a recent poll gave these choices:

  • I can’t work without the command line
  • I think it’s time for a new way to draw without the command line

In a follow-up post, the observation was made that “We thought that only a few people would work without a command line, but the results were refreshing.” Apparently, only 66% of respondents selected the first of the available options.

To this I respond, “Beware the trap of the biased sample”. The poll asked people who are largely users of a product that involves drawing without a command line if they can work without it. In response, an amazing 2/3 of them say “I can’t work without the command line”, i.e. they can’t possibly do what they are currently doing, every time they use the product on which the blog is based.

How is that “refreshing”? 34% is an incredibly small number when the only alternative answer is self-contradictory. It should be very close to 100%, surely?

Every poll has a biased sample, including my own polls here. The trick is in working out how strong the bias is and determining if it invalidates the results. In this case, readers of the Butterfly blog are largely users of a command-line-less product and therefore likely to have a strong bias against the command line. So that 66% number would be a bit bigger if addressed to a more general population, I reckon.

I’ve added my own poll for my own biased sample (that’s you lot out there, largely users of a command line-based application) using exactly the same question format. I’m not entirely happy with the way the options are worded as it is not entirely neutral, but I’ll stick with it for the purpose of the comparison.

While I might dispute the conclusions that might be drawn from the poll, I must say that I like the way the Project Butterfly team is doing this in the open. It’s much better than the traditional Autodesk practice of claiming that what they are doing is supported by polls among customers, then refusing all requests for the full details of those polls. As the devil is in the details, I automatically discount any such claims based on secret research, from Autodesk or anyone else. I encourage the Butterfly people to keep doing what they are doing, regardless of any nitpicking from me; it is very refreshing (there’s that word again) to see Autodesk being open and I want to encourage it.

In addition to voting, I’d love to have you add your own comments either for or against use of the command line in CAD. It may be old and unfashionable, but does that make it inefficient? Have you tried turning it off in AutoCAD and running purely on Dynamic Input? Have you had experience with CAD or similar products without command lines? Let’s hear it.

AutoCAD does a Cheshire Cat

In Alice’s Adventures in Wonderland, the Cheshire Cat gradually disappears until nothing is left but its smile. The AutoCAD packaging has done the same thing over the years until now nothing is left but the 0s and 1s. In Release 13, one box was not enough to keep all the materials, but Autodesk gradually slimmed it down until in recent years your slab of upgrade or Subscription cash gets you nothing but a DVD in a case (with or without a pack of cards). However, you can go cap in hand to Autodesk and ask for a real manual of your choice, which will be shipped to you free of charge.

A few days ago, Subscription customers in 37 countries were all automatically opted in to a download-only upgrade mechanism for all Autodesk software, not just AutoCAD. Here are Autodesk’s stated reasons:

  • Convenience—It’s more convenient than installing software from a DVD or CD and is available 24 hours a day.
  • Sustainability—Because there’s no printing, packaging, or shipping, it’s a more sustainable choice.
  • Central control—Software Coordinators can provide users with electronic access to upgrades and manage software permissions centrally.

So this has nothing to do with increasing Autodesk’s profit margins, it is for your benefit and to help save the planet; that’s nice to know. However, depending on your circumstances and the available bandwidth at both your end and Autodesk’s, downloading a couple of GB or so for each product (double it if you need both 32 and 64 bit versions) may not be convenient. If you want to receive an actual disc containing the software, you will need to change a Subscription setting. You should have seen an email about this containing a convenient link to a page containing that setting.

If you haven’t taken care of this yet, I suggest you log on to the Subscription site, edit your Subscription Center Profile (click on My Profile in the top right) and change the Delivery Preference setting to Box. If there are multiple contact people on your Subscription contract, I suggest you ask your colleagues (particularly the person designated to be the Contract Manager) to do likewise. Having a box shipped to you does not prevent you from downloading the software. I suggest you do this sooner rather than later, because if you leave it until less than a week before the next release (historically mid-March), you’ll miss out.