December 7, 2013
My previous blogpost, comparing footprints of DV Leaders (Tableau 8.1, Qlikview 11.2, Spotfire 6) on disk (in terms of size of application file with embedded dataset with 1 million rows) and in Memory (calculated as RAM-difference between freshly-loaded (without data) application and the same application when it will load appropriate application file (XLSX or DXP or QVW or TWBX) got a lot of feedback from DV Blog visitors. It even got mentioning/reference/quote from Tableau Weekly #9 here:
http://us7.campaign-archive1.com/?u=f3dd94f15b41de877be6b0d4b&id=26fd537d2d&e=5943cb836b and the full list of Tableau Weekly issues is here: http://us7.campaign-archive1.com/home/?u=f3dd94f15b41de877be6b0d4b&id=d23712a896
The majority of feedback asked to do a similar Benchmark – the footprint comparison for larger dataset, say with 10 millions of rows. I did that but it required more time and work, because the footprint in memory for all 3 DV Leaders depends on the number of visualized Datapoints (Spotfire for years used the term Marks for Visible Datapoints and Tableau adopted these terminology too, so I used it from time to time as well, but I think that the correct term here will be “Visible Datapoints“).
Basically I used the same dataset as in previous blogpost with main difference that I took subset with 10 millions of rows as a opposed to 1 Million rows in previous Benchmarks. The Diversity of used Dataset with 10 Million rows is here (each row has 15 fields as in previous benchmark):
I removed from benchmarks for 10 million rows the usage of Excel 2013 (Excel cannot handle more the 1,048,576 rows per worksheet) and PowerPivot 2013 (it is less relevant for given Benchmark). Here are the DV Footprints on disk and in Memory for Dataset with 10 Million rows and different number of Datapoints (or Marks: <16, 1000, around 10000, around 100000, around 800000):
Main observations and notes from benchmarking of footprints with 10 millions of rows as following:
Tableau 8.1 requires almost twice less disk space for its application file .TWBX then application files for Qlikview 11.2 (.QVW) and Spotfire 6 (.DXP).
Tableau 8.1 is much smarter when it uses RAM then Qlikview 11.2 and Spofire 6, because it takes advantage of number of Marks. For example for 10000 Visible Datapoints Tableau uses 13 times less RAM than Qlikview and Spotfire and for 100000 Visible Datapoints Tableau uses 8 times less RAM than Qlikview and Spotfire!
THe Usage of more than say 5000 Visible Datapoints (even say more than a few hundreds Marks) in particular Chart or Dashboard often the sign of bad design or poor understanding of the task at hand; the human eye (of end user) cannot comprehend too many Marks anyway, so what Tableau does (in terms of reducing the footprint in Memory when less Marks are used) is a good design.
For Tableau in results above I reported the total RAM used by 2 Tableau processes in memory TABLEAU.EXE itself and supplemental process TDSERVER64.EXE (this 2nd 64-bit process almost always uses about 21MB of RAM). Note: Russell Christopher also suggested to monitor TABPROTOSRV.EXE but I cannot find its traces and its usage of RAM during benchmarks.
Qlikview 11.2 and Spotfire 6 have similar footprints in Memory and on Disk.
December 3, 2013
More than 2 years ago I estimated the footprints for the sample dataset (428999 rows and 135 columns) when it encapsulated in text file, in compressed ZIP format, in Excel 2010, in PowerPivot 2010, Qlikview 10, Spofire 3.3 and Tableau 6. Since then everything upgraded to the “latest versions” and everything 64-bit now, including Tableau 8.1, Spotfire 5.5 (and 6), Qlikview 11.2, Excel 2013 and PowerPivot 2013.
I decided to use the new dataset with exactly 1000000 rows (1 million rows) and 15 columns with the following diversity of values (Distinct Counts for every Column below):
Then I put this dataset in every application and format mentioned above – both on disk and in memory. All results presented below for review of DV blog visitors:
Some comments about application specifics:
Excel and PowerPivot XLSX files are ZIP-compressed archives of bunch of XML files
Spotfire DXP is a ZIP archive of proprietary Spotfire text format
QVW is Qlikview’s proprietary Datastore-RAM-optimized format
TWBX is Tableau-specific ZIP archive containing its TDE (Tableau Data Extract) and TWB (XML format) data-less workbook
Footprint in memory I calculated as RAM-difference between freshly-loaded (without data) application and the same application when it will load appropriate application file (XLSX or DXP or QVW or TWBX)
November 26, 2013
Posted by Andrei Pandre under Comparison
Leave a Comment
Since we approaching (in USA that is) a Thanksgiving Day for 2013 and shopping is not a sin for few days, multiple blog visitors asked me what hardware advise I can share for their Data Science and Visualization Lab(s). First of all I wish you will get a good Turkey for Thanksgiving (below is what I got last year):
I cannot answer DV Lab questions individually – everybody has own needs, specifics and budget, but I can share my shopping thoughts about needs for Data Visualization Lab (DV Lab). I think DV Lab needs many different types of devices: smartphones, tablets, projector (at least 1), may be a couple of Large Touchscreen Monitors (or LED TVs connectable to PCs), multiple mobile workstations (depends on size of DV Lab team), at least one or two super-workstation/server(S) residing within DV Lab etc.
Smartphones and Tablets
I use Samsung Galaxy S4 as of now, but for DV Lab needs I will consider either Sony Xperia Z Ultra or Nokia 1520 with hope that Samsung Galaxy S5 will be released soon (and may be it will be the most appropriate for DV Lab):
My preference for Tablet will be upcoming Google Nexus 10 (2013 or 2014 edition – it is not clear, because Google is very secritive about it) and in certain cases Google Nexus 7 (2013 edition). Until Nexus 10 ( next generation) will be released, I guess that two leading choices will be ASUS Transformer Pad TF701T
and Samsung Galaxy Note 10.1 2014 edition (below is a relative comparison of the size of these 2 excellent tablets):
Projectors, Monitors and may be Cameras.
Next piece of hardware in my mind is a projector with support for full HD resolution and large screens. I think there are many good choices here, but my preference will be BENQ W1080ST for $920 (please advise if you have a better projector in mind in the same price range):
So far you cannot find too many Touchscreen Monitors for reasonable price, so may be these two 27″ touchscreen monitors (DELL P2714T for $620 or Acer T272HL bmidz for $560) are good choices for now:
I also think that a good digital camera can help to Data Visualization Lab and considering something like this (can be bought for $300): Panasonic Lumix DMC FZ72 with 60X optical zoom and ability to do a Motion Picture Recording as HD Video in 1,920 x 1,080 pixels - for myself:
Mobile and Stationary Workstations and Servers.
If you need to choose CPU, I suggest to start with Intel’s Processor Feature Filter here: http://ark.intel.com/search/advanced . In terms of mobile workstations you can get quad-core notebook (like Dell 4700 for $2400 or Dell Precison 4800 or HP ZBook 15 for $3500) with 32 GB RAM and decent configuration with multiple ports, see sample here:
If you are OK with 16GB of RAM for your workstation, you may prefer Dell M3800 with excellent touchscreen monitor (3200×1800 resolution) and only 2 kg of weight. For a stationary workstation (or rather server) good choices are Dell Precision T7600 or T7610 or HP Z820 workstation. Either of these workstations (it will cost you!) can support up to 256GB RAM, up to 16 or even 24 cores in case of HP Z820), multiple high-capacity hard disks and SSD, excellent Video Controllers and multiple monitors (4 or even 6!) Here is an example of backplane for HP Z820 workstation:
I wish to visitors of this blog a Happy Holidays and good luck with their DV Lab Shopping!
November 19, 2013
Since Datawatch bought recently well-known swedish Data Visualization vendor Panopticon (which had 112% YoY in 2012!) for $31M in stock, Panopticon’s sales for a first time added to Datawatch sales (at least $1.5M revenue per quarter), total Datawatch quarterly revenue (as expected) grew to almost $9M per quarter and to $30.3M per fiscal 2013 (ending 9/30/13).
You can compare “moving” Datawatch YoY index for last 6 quarters vs 2 Top DV Performers (Tableau above 70% YoY, Qlikview above 20%), vs similar (YoY-wise) DV Vendor (Spotfire about 12%) and finally vs 2 Traditional BI Vendors (Microstrategy and Actuate). The thickness of lines reflects Vendor’s ttm (the revenue for Trailing Twelve Months) – click on Image to Enlarge:
Year-over-Year Growth for Trailing Twelve Month (YoY4ttm)
Datawatch founded in 1985(!), public (traded on NASDAQ as DWCH) since 1992; it has 44000+ customers (including 99 of Fortune 100) and 500000+ end users. Datawatch management team is experienced in BI space and includes veterans from IBM, Applix, Cognos etc. In last 3 years (since 10/1/10) DWCH shares increased in value more then 10 times:
2nd V for BigData: Data Variety.
The first version of main Datawatch software, called Monarch Professional was released in 1991 and developed by Math Strategies. Overtime Datawatch added a lot of features to this ETL software, including the support for the broadest variety of data types and data sources simultaneously—including traditional structured relational databases, semi-structured sources like reports, PDF files, EDI streams, print spools and documents stored in files systems or enterprise content management systems, with a new mix of unstructured data such as machine data and social media stored in Big Data solutions or streaming directly from a host of real-time applications.
Datawatch Desktop does ETL from all above Data Sources and then extracts those data into Variety of Standard Formats: Excel spreadsheets, Access Databases, PDF reports, into Panopticon Workbooks etc. Simple example of how Monarch 11 does it you can see here:
The latest release of Monarch Professional is in version 12 and it has the new name as Datawatch Modeler; it also integrated and bundled together with Panopticon Desktop Designer under new name Datawatch Desktop and that bundle is available for $1895. As a result Datawatch created for itself an excellent up-sell opportunity: current customers on maintenance can trade-up to Datawatch Desktop for $366 (it also includes first year maintenance) – this is 5 times cheaper than Tableau Desktop professional. My understanding that maintenance of Datawatch Desktop is 22% per year of its price but you may get a better deal.
Datawatch Modeler v.12 has new Core engine with 16 External Lookups (was 9 in version 11), 512 Columns In Table (was 254), 100 Multi-Column Regions (was 40), Optimized for modelling large inputs Data Preview (work with first 100 records), has new PDF Engine, 10GB Internal Database size (was 2GB), Utilized 4 Cores for DB operations (was 2).
1st V for Big Data: Data Volume.
Math Strategies developed for Datawatch another tool – Monarch DataPump (recently renamed as Datawatch Automator or Datawatch Server – Automation Edition, currently in version 12). On 3/30/12 Datawatch acquired intellectual property for its underlying Monarch Report Analytics platform from Raymond Huger, d/b/a Math Strategies (Greensboro, NC).
Datawatch developed other editions of Datawatch Server:
Formerly Enterprise Server has new name now as Datawatch Server – Content Edition, version 12. Datawatch Server supports all Monarch functionality on server-side, integrates with web server(s) and related infrastructure, manages all users, their credentials, access rights, roles, privileges, user groups, manages and aggregates all content, data, data extracts etc.
Datawatch Server – Automation Edition (Data Pump) – automatically collects and refreshes all content, data and data extracts, both on-demand and on-schedule, manages all schedules etc.
Datawatch Server – Complete Edition includes Formerly Panopticon Server (manages all Data Visualizations and its users, converts Visualizations to web applications so they can be accessed through web browsers and HTML5 clients), Datawatch Enterprise Server and Data Pump.
Theoretically Datawatch Server (with help from Datawatch Automator) can support up to 524 Petabytes (1015 bytes) of Data which I consider a very Big Data for 2013.
3rd V for Big Data: High Velocity
Datawatch/Panopticon in-memory data engine supports data visualization for real-time business dashboards and it has low-latency display of analytics that are based on streaming data as it arrives. This enables Datawatch to handle the demanding continuous-intelligence applications, where quick responses are required. This is a big differentiator. An in-memory, OLAP-based StreamCube is associated with each graphical display object. The system processes new data as it arrives, selects the subset of important data, recalculates the relevant sections of the model and refreshes the associated parts of the display immediately. The parts of the model and the display that are not affected by the new data are not touched. This is faster and more efficient than conventional data visualization tools that operate on batch-loaded snapshots of data, run less frequently, and then recalculate the model and rebuild the display for each iteration.
Somebody I know was able to refresh and REPAINT 25000+ datapoints per second per one Datawatch/Panopticon Chart and this is much faster then any competitor.
Datawatch platform integrated with message-oriented middleware, including ActiveMQ, Qpid, Sonic MQ and Tibco EMS. It has connectors to Complex Event-Processing platforms (CEP), such as kx kdb+tick, OneTick CEP, Oracle CEP, StreamBase Systems’ Event Processing Platform and Sybase Event Stream Processor. Datawatch also has interfaces for retrieving data from time series databases, conventional relational and columnar databases, files, Open Data Protocol (OData) sources and in-memory DBMSs. It can be customized for proprietary data sources (recent example is a Visualization Accelerator for Splunk) and even embedded within other applications. Like other leading data visualization tools, it supports a wide range of charts. It has a development studio (Desktop Designer) for designing and implementing dashboards, and HTML5-based clients/support for mobile applications.
4th and most desirable V: Data Visualization
Datawatch is trying to get into Data Visualization (DV) field and it has potentials to be a 4th major Vendor here: it has a competitive DV Desktop, a competitive DV Server, an excellent HTML5 Client for it and set of differentiators like ready-to-use 3V triplet of features (see above) for Big Data and real-time DV. Datawatch Designer supports rich set of Graphs, Charts, Plots, Maps, Marks and other types of Visualizations, for example:
TIME SERIES Graphs: Candlestick, Horizon, Line, Needle, OHLC, Spread, Stack Area, Stacked / Grouped Needle, Table with Micro Charts, Sub Totals & Grand Totals, Timeseries Combo Charts, Timeseries Scatter Plot.
STATIC & TIME SLICE Graphs: Bullet, Heat Map, Heat Matrix, Horizontal/Vertical Bar, Horizontal/Vertical Dot Plot, Multi-Level Pie Chart, Numeric Line, Numeric Needle, Numeric Stacked Needles, Scatter Plot, Shapes / Choropleth, Surface Plot, Surface Plot 3D, Table with Micro Charts, Sub Totals & Grand Totals, Treemap.
In my humble opinion in order to compete with leading DV vendor like Tableau I think that Datawatch needs a few gradual changes, some of them I listed below:
Gradually on as-needed basis add features which other 3 DV Vendors have and Datawatch does not (it needs serious R&D)
Create free Datawatch Public (cloud service) to make people to learn and compare it (similar to Tableau Public) and to win mindshare
Create Fee-based Datawatch Online cloud service (similar to Tableau Online and Spotfire Cloud services)
Add more DV-oriented Partners (similar to Qlikview Partner Program, which has now 1500+ partners)
Create fee-based Data Visualization Practice in order to help large clients to implement DV Projects with Datawatch Desktop and Server.
Add support for Visual Analytics and Data Science, including integration with R Library (similar to Spotfire’s S-Plus and TERR or at least the integration with R like Tableau 8.1 did today)
Add support for Storytelling, similar to what next versions of Tableau and Qlikview will have (soon) and communication abilities (similar to what Spotfire 6 has with TIBBR)
I may expand this list later as I see the fit, but Datawatch really has an unique opportunity here and large potential market!
Feedback 11/22/13 from multiple visitors of this blog:
I Quote the email from one of frequent visitors to my blog: “The fastest growing sales are in DV field (e.g. Panopticon revenue was 112% YoY in 2012). For example in 2006, when Qliktech’s Sales were $44M, its YoY was 81%; 4 years later, in 2010, when Tableau had $40M revenue, YoY was 106%, see it here: http://www.prnewswire.com/news-releases/tableau-software-doubles-revenue-with-2010-landmark-year-114913924.html and 4 years later, in 2014 history can repeat itself again if Datawatch will allow to unbundle its DV Products and sell them separately. Instead, currently Datawatch prevents its own salesforce to sell separately own DV products like Panopticon Desktop Designer (you may call it now as Datawatch Visualization Studio) and Panopticon Server (you can call it now as Datawatch Visualization Server). That artificial limitation has to be removed!” visitor said to me over email… All I can say: it is not my call…
November 12, 2013
In past Vikings discovered America, conquested or colonized parts of England, Russia, Ireland, Scotland, even Southern Italy and Iceland… But in 21st century (as far as this blog is concerned) Sweden became a Motherland of Data Visualization:
Let’s start with most famous Data Viking and most known Storyteller in Data Visualization field – prof. Hans Rosling from Karolinska Institutet and chairman of the Gapminder Foundation (in Stockholm). Gapminder’s team invented the popular and useful 6-dimensional Motion Chart and developed Trendalizer which was bought by Google in 2007, see it here: https://developers.google.com/chart/interactive/docs/gallery/motionchart . The recent example of Prof. Rosling Storytelling you can see here:
In Stockholm you can find another Data Visualization Innovator – Panopticon is a leader in Complex Even Processing and real-time Visual Analytics. Among other innovation here is the example of Panopticon’s invention (by its senior developer Hannes Reijner) of Horizon Chart, see sample here:
and short video about it here:
In 2012 Panopticon posted 112% Year-Over-Year revenue growth (comparable with Tableau). In 2013 (the all stock deal closed by the end of September, 2013.) Datawatch bought Panopticon for $31.4M and I assume it will try to move some R&D from Sweden to Chelmsford, MA.
In Göteborg/Gothenburg you can find R&D office of another DV Leader – Spotfire with 60+ Data Vikings. In 2007 TIBCO bought Spotfire for $195M but even now in 2013 unable to move R&D into USA. So now Spotfire actually has 3+ main offices: TIBCO Corporate Headquarters in California, Spotfire Headquarters in Somerville, MA (estimate is 15% of Spotfire workforce) and main R&D office in Sweden. In addition, lately TIBCO choose the strategy to buy rather then build new features, for example, just in 2013 they added to Spotfire portfolio the following new companies and as result they have even more distributed R&D team now:
- Extended Results (PushBI) in Redmond, WA
- MAPORAMA in Paris, France
- StreamBase Systems, Inc. in Waltham, MA
As a result, despite the fact that Spotfire 6 is the most mature Data Visualization platform on market, people in TIBCO Corporate Headquarters running into risk of do not have enough knowledge of their own major Intellectual Properties.
In southern Sweden – Lund, we can find Swedish Headquarters of the major DV Leader – Qliktech, who occupied almost half of Data Visualization market in terms of sales. At least 140 Data Vikings located in Lund and may be another 200 elsewhere in Sweden. Qliktech’s Data Vikings are major innovators with features like the fastest in-memory Data Engine, most natural Visual Drill-down, Associative Query Language to name a few. This also presents a major problem for Qliktech, because they have Headquarter in Radnor, PA (where only 150+ employees work (estimate), which is less then 10% of Qliktech’s workforce!), Main marketing, sales and support office in Newton, MA (estimate: less then 5% of workforce) and most R&D in Lund (estimate: at least 10% of workforce).
This means that almost 500 technically advanced Data Visualization experts (engineers, developers, architects etc., which is at least 23% of total Qliktech+Spotfire workforce) are still in Sweden. The simple observation of Tableau’s TCC13 conference in September 2013 shows that Tableau’s top managers and officers know their product deeper and more intimately then their counterparts in Qliktech and Spotfire. That is very easy to explain: because 650+ Tableau’s employees (almost 65% of their workforce and most developers, managers and officers) work in the same Main HQ office in Seattle, WA and they obviously talking to each other in-person and often!
My humble advice to Qliktech, Spotfire and Datawatch is simple – gradually relocate as much Data Vikings from Sweden to appropriate headquarters in USA or find and hire local american equivalents of those Swedish geniuses…
As a background for this advice, please consider this information (updated on 11/17/13): statistics of job openings clearly showing that all 3 DV Leaders keep doing (by inertia) what they did in past with only difference that it worked recently for Tableau and does not work for Qliktech and Spotfire. Here are specific examples:
Tableau has 176 job openings (much more then Qlikview (only 80) and Spotfire(only 18) combined)!
97 (55%) of Tableau openings are in Seattle, more then half of Tableau’s openings are engineering and technical positions!
Qliktech has 17 (21%) positions opened in Lund, only 10 (12%) in Radnor and 4 (5%) in Newton, MA. Only 11 (14%, 9 times less then at Tableau in absolute numbers) Qliktech’s openings are engineering and technical.
Spotfire has only 18 openings (1 in Göteborg, 5 in CA, 4 in MA) and only 4 Spotfire’s positions (out of 18, 22% that is) are engineering or technical.
This statistics clearly showing that neither Qliktech no TIBCO see the wrong pattern and huge problem here and that can be a reason for disruption in the future and the gradual relocation of Data Vikings is only way to prevent the danger… And of course, if you can afford, find and hire equal talents in USA Headquarters then by all means keep geniuses in Sweden without relocation which is a half-similar to what Tableau does (HALF is because Tableau historically does not need to maintain the significant R&D office outside of USA)!
November 3, 2013
Something dramatic happened during October 2013 with Data Visualization (DV) Market and I feel it everywhere. Share Prices for QLIK went down 40% from $35 to $25, for DATA went down 20% from $72 to below $60, for MSTR went up 27% from $100 to $127 and for DWCH went up 25% from $27.7 to $34.5. This blog got 30% more visitors then usual and it reached 26000 visitors per month of October 2013!
So in this blog post I revisited who are actually the DV leaders and active players in Data Visualization field, what events and factors important here and I also will form the DVIndex containing 4-6 DV Leaders and will use it for future estimate of Marketshare and Mindshare in DV market.
In terms of candidates for DV Index I need measurable players, so I will prefer public companies, but will mention private corporations if they are relevant. I did some modeling and it turned out that the best indicator for DV Leader if its YoY (Year-over-Year Revenue growth) is larger than 10% – it will separate obsolete and traditional BI vendors and me-too attempts from real DV Leaders.
Let’s start with traditional BI behemoths: SAP, IBM, Oracle and SAS: according to IDC, their BI revenue total $5810M, but none of those vendors had YoY (2012-over-2011) more then 6.7% ! These 4 BI Vendors literally desperate to get in to Data Visualization market (for example SAP Lumira, IBM is getting desperate too with Project Neo (will be in beta in early 2014), Rapidly Adaptive Visualization Engine (RAVE), SmartCloud Analytics-Predictive Insights, BLU Acceleration, InfoSphere Data Explorer or SAS Visual Analytics) but so far they were not competitive with 3 known DV Leaders (those 3 are part of DVIndex for sure) Qlikview, Tableau and Spotfire…
5th traditional BI Vendor – Microsoft had BI revenue in 2012 as $1044M, YoY 16% and added lately a lot of relevant features to its Data Visualization toolbox: Power Pivot 2013, Power View, Power Query, Power Map, SSAS 2012 (and soon SQL Server 2014) etc. Unfortunately Microsoft does not have Data Visualization Product but pushing everything toward Office 365, SharePoint and Excel 2013, which cannot compete in DV market…
6th Traditional BI vendor – Microstrategy made during October 2013 a desperate attempt to get into DV market by releasing 2 free Data Visualization products: Microstrategy Desktop and Microstrategy Express, which are forcing me to qualify Microstrategy for a status of DV Candidate, which I will include (at least temporary) into DVIndex. Microstrategy BI revenue for TTM (Trailing 12 months) was $574, YoY is below 5% so while I can include it into DVIndex, I cannot say (yet?) that Microstrategy is DV Leader.
Datawatch Corporation is public (DWCH), recently bought advanced Data Visualization vendor – Panopticon for $31M. Panopticon TTM Revenue approximately $7M and YoY was phenomenal 112% in 2012! Combining it with $27.5M TTM Revenue of Datawatch (45% YoY!) giving us approximately 55% YoY for combined company and qualifying DWCH as a new member of DVIndex!
Other potential candidates for DVIndex can be Panorama (and their Necto 3.0 Product), Visokio (they have very competitive DV Product, called Omniscope 2.8), Advizor Solution with their mature Advizor Visual Discovery 6.0 Platform), but unfortunately all 3 companies choose to be private and I have now way to measure their performance and so they will stay as DV Candidates only.
In order to monitor the progress of open source BI vendors toward DV Market, I also decided to include into DVIndex one potential DV Candidate (not a leader for sure) – Actuate with their BIRT product. Actuate TTM revenue about $138M and YoY about 3%. Here is the tabular MarketShare result with 6 members of DVIndex:
Please keep in mind that I have no way to get exact numbers for Spotfire, but I feel comfortable to estimate Spotfire approximately as 20% of TIBCO numbers. However, I feel Spotfire YoY is 16% which is higher then 11% TIBCO has. Numbers in table above are fluid and reflect the market situation by the end of October 2013. Also see my attempt to visualize the Market Share of 6 companies above in simple Bubble Chart (click on it to Enlarge; where * X-axis: Vendor’s Revenue for last TTM: 12 trailing Months, * Y-axis: Number of Full-Time Employees, working for given Vendor, * Sized by Market Capitalization, in $B (Billions of Dollars), and * Colored by Year-Over-Year revenue Growth):
For that date I also have an estimate of Mindshare of all 6 members of DVIndex by using the mentioning of those 6 companies by LinkedIn members, LinkedIn groups, posted on LinkedIn job openings and companies with Linkedin profile:
Again, please see below my attempt to represent Mindshare of those 6 companies above with simple Bubble Chart ((click on it to Enlarge; here 6 DV vendors, positioned relatively to their MINDSHARE on LinkedIn and where * X-axis: Number of LinkedIn members, mentioned Vendor in LinkedIn profile, * Y-axis: Number of LinkedIn Job Postings, with request of Vendor-related skills, * Sized by number of companies mentioned them on LinkedIn and * Colored by Year-Over-Year revenue Growth):
Among other potential DV candidates I can mention some recent me-too attempts like Yellowfin, NeitrinoBI, Domo, BIME, RoamBI, Zoomdata and multiple similar companies (mostly private startups) and hardly commercial but very interesting toolkits like D3. None of them have impact on DV Market yet.
Now, let’s review some of October events (may add more October events later):
1. For the fourth quarter, Qliktech predicts earnings of 28 cents to 31 cents a share on revenue between $156 million and $161 million. The forecast came in significantly lower than analysts’ expectations of 45 cents a share on $165.78 million in revenue. For the full year, the company projects revenue between $465 million and $470 million, and earnings between 23 and 26 cents a share. Analysts had expectations of 38 cents a share on $478.45 million. As far as I concern it is not a big deal, but traders/speculants on Wall Street drove QLIK prices down almost 40%
2. Tableau Software Files Registration Statement for Proposed Secondary Offering. Also Tableau’s Revenue in the three months ended in September rose to $61 million, 10 millions more then expected - Revenue jumped 90%! Tableau CEO Christian Chabot said the results were boosted by one customer that increased its contract with the company. ”Our third quarter results were bolstered by a large multimillion-dollar deal with a leading technology company,” he said. “Use of our products in this account started within one business unit and over the last two years have expanded to over 15 groups across the company. ”Recently, this customer set our to establish an enterprise standard for self-service business intelligence, which led to the multimillion-dollar transaction. This deal demonstrates the power and value of Tableau to the enterprise.” However DATA prices went down anyway in anticipation of a significant portion of these Shares Premium prices should quickly evaporate as the STOCK Options lock-up will expire in November 2013.
3. TIBCO TUCON 2013 conference somehow did not help TIBCO stock but in my mind brought attention to Datawatch and to the meteoric rise of DWCH stock (on Chart below compare it with QLIK and TIBX prices, which basically did not change during period of March-October of 2013) which is more then tripled in a matter of just 8 months (Datawatch bought and integrated Panopticon during exactly that period):
4. Datawatch now has potentially better software stack then 3 DV Leaders, because of Datawatch Desktop is integrated with Panopticon Desktop Designer and Datawatch Server is integrated with Panopticon Data Visualization Server; it means that in addition to “traditional” BI + ETL + Big Data 3V features (Volume, Velocity, Variety) Datawatch has 4th V feature, which is relevant to DV Market: the advanced Data Visualization. Most visualization tools are unable to cope with the “Three V’s of Big Data” – volume, velocity and variety. However, Datawatch’s technology handles:
Data sources of any size (it has to be tested and compared with Qlikview, Spotfire and Tableau)
Data that is changing in real time (Spotfire has similar, but Qlikview and Tableau do not have it yet)
Data stored in multiple types of systems and formats
We have to wait and see how it will play out but competition from Datawatch will make Data Visualization market more interesting in 2014… I feel now I need to review Datawatch products in my next blog post…
October 24, 2013
Yesterday I got invited by Qliktech for their semi-annual New England QlikView Boston User Group meeting. It was so many participants, so Qliktech was forced to hold the Keynote (of course the presentation and the demo of Qlikview.Next) and 4 cool presentations by Customers and Partners (Ocean State Job Lot, Analog Devices, Cybex and Attivio) outside of its own office but in the same building on the 1st floor @Riverside Offices in Newton, MA @Rebecca’s Cafe.
It was plenty of very excited people in a very large room and very promising demo and presentation of Qlikview.Next, which actually will not be generally available until 2014. Entire presentation was done using new and capable HTML5 client, based on functionality Qliktech got when it bought NComVA 6 months ago.
I was alarmed when presenter never mentioned my beloved Qlikview Desktop and I when I asked directly about it, the answer shocked and surprised me. One of the most useful piece of software I ever used will not be part of Qlikview.Next anymore. As part of Qlikview 11.2, it will be supported for 3 years and then it will be out of the picture! I did not believe it and asked one more time during demo and 2 more times after presentation in-person during Networking and Cocktail Hour inside Qliktech offices. While food and drink were excellent, the answer on my question was the same – NO!
I have the utmost respect for very smart software developers, architects and product managers of Qlikview, but in this particular case I have to invoke 20+ years of my own advanced and very extensive experience as the Software Architect, Coder and Software Director and nothing in my past can support such a decision. I do not see why Qlikview.Next can not have both (and we as Qlikview users need and love both) Qlikview Desktop Client and Qlikview HTML5 client?
I personally urge Qliktech (and I am sure the majority of 100000+ (according to Qliktech) Qlikview community will agree with me) to keep Qlikview Desktop client as long as Qlikview exist. And not just keep it but 1st, keep it as the best Data Visualization Desktop Client on market and 2nd, keep it in sync (or better ahead) with HTML5 client.
In case if Qlikview Desktop will disappear from Qlikview.Next, it will be a huge gift to Tableau and Datawatch (Spotfire Cloud Personal will no longer have access to the Spotfire Analyst desktop product and therefor Spotfire Cloud Personal is making a similar (partial) mistake as Qlikview.Next)
Tableau recently invested heavily into progress of all variations of Tableau Desktop (Professional, Personal, Public, Online, Free Reader) including (finally) migration to 64-bit and even porting Desktop to MAC, so it will instantly get the huge advantage over Qlikview in desktop, workstation, development, design, debugging, testing, QA and offline environments.
It will also almost immediately propel the Datawatch as a very attractive contender in Data Visualization market, because Datawatch got (when they bought Panopticon this year) the extremely capable Panopticon Desktop Designer
in addition to its own very relevant line of products.
Again, I hope I misunderstood answer I got 4 times during 4-hour meeting and during follow-up networking/cocktail hour or if understood it correctly, Qliktech will reconsider, but I will respect their decision if they don’t…
So I have to disagree with Cindi Howson (as usual): even if “QlikTech Aims To Disrupt BI, Again“, it actually will disrupt itself first, unless it will listen me begging them to keep Qlikview Desktop alive, well and ahead of competition.
You can find in Ted Cuzzillo’s article here: http://datadoodle.com/2013/10/09/next-for-qlik/ the actual quote from Qliktech’s CEO Lars Björk: ““We can disrupt the industry again”. My problem with this quote that Qliktech considers itself as the insider and reinventor of the dead and slow BI industry, while Tableau with its new motto “DATA to the people” is actually trying to be out of this grave and be inside own/new/fast growing Data Visualization space/field/market, see also blogpost from Tony Cosentino, VP of Ventana Research, here: http://tonycosentino.ventanaresearch.com/2013/09/21/tableau-continues-its-visual-analytics-revolution/#!
You can see below interview with Time Beyers, who has own doubts about Qlikview.Next from investor’s point of view:
Basically, Qlikview.Next is late for 2 years, it will not have Qlikview Desktop (big mistake), it still does not promise any Qlikview Cloud services similar to Tableau Online and Tableau Public and it still does not have server-less distribution of visualizations because it does not have free Qlikview Desktop Viewer/Readers similar to free Tableau Reader. So far it looks to me that QLIK may have a trouble in the future…