This week we had a blast mingling with procurement and finance gurus at the Coupa INSPIRE Conference in San Francisco, where there was lots of conversation about sparking a revolution in spend optimization. We were there spreading the SnapLogic love and demoing our Coupa Snap, which you can check out in this product video:
It was especially great to catch up with some of our joint customers like Pandora, which uses SnapLogic to move tons of order and planning data between Coupa and its many other cloud applications. You can read more about the awesome productivity and agility benefits that cloud integration delivers for Coupa customers in our press release. For those who didn’t make it, here are some pictures of the buzzing exhibit hall:
Next up, we’re off to the Big Data Innovation Summit in San Francisco for the rest of this week. And if you’re in the Chicago area, please stop by and say hi during CampIT’s Cloud Computing Strategies event tomorrow or the Salesforce.com Customer Company Tour, where we’ll be exhibiting on Thursday, April 18.
The votes are in, and we’re excited to be recognized as the DataWeek Top Innovator in the category of best Platform/API, after joining the list of 2012’s Top 100 Data Innovators earlier this year. Thanks to the 500 people who voted for us amongst 85 nominees! We’ll be celebrating with other data industry leaders like Amazon AWS, Salesforce and Terracotta at next month’s DataWeek 2012 Conference & Festival in San Francisco.
Harnessing data is something we’re passionate about here at SnapLogic. Our fearless product leader, Zeb Mahmood, will even be speaking on a panel about it called “The Future of the Business Cloud” at DataWeek on Sept 25th. In the meantime, let us know how your enterprise is using data and the cloud in new ways in the comments below!
P.S. If you’ll be joining us at DataWeek, feel free to use discount code “DataWeek25” at Dataweek.eventbrite.com for 25% off your registration.
It’s always satisfying to be recognized for all our hard work here at SnapLogic, so we were thrilled to win the Best Cloud Platform award at the 3rd Annual Cloud Computing World Forum in London this week. Props go out to our fellow Cloud Computing World Series Awards winners, like Microsoft and VMWare, who were also recognized for their achievements by the stellar lineup of judges.
As a startup, it’s pretty fun to see our trophy shelf grow, and we’re excited to get this one up there next to other recent wins like our Techie Gold Award and our Ventana Research Leadership Award for cloud computing (which we share with ourinnovative customer, the Advisory Board Company).
Now, here’s to hoping that the San Francisco Giants get a shot at the MLB World Series on this side of the pond in the fall…
Drea Thomas is the engineering director responsible for the front end technology at SnapLogic – which explains his clear bias toward Designer and all things visual.
When you build a data integratio
n platform, it is easy to expect integrations to look like something from a demo:
n platform, it is easy to expect integrations to look like something from a demo:
But, as we’ve learned over the years, real-world integrations often are a lot messier and can look more like:
The Spring ‘12 release of the SnapLogic Server is all about improving the user experience dealing with large and complex pipelines. The goal is to reduce the time required to build a complex pipeline by an order of magnitude. Let me outline some of the improvements we’ve made to the product to address this.
In previous versions of the product, calculating pass-through fields (something that is quite complex) was done on the server side. This makes a lot of sense because you can centralize the code in one place and re-use it for Designer, or for any application that builds pipelines using SNAPI. But, when your pipelines look like RealWorld, the pipeline definition is quite large – sometimes several megabytes. Sending it back and forth over the wire introduces significant latency.
In Spring ‘12, we’ve moved some of the most frequently used server logic into the client to greatly reduce latency. In some cases, this leads to a 300% improvement in Designer performance.
In DemoLand, every pipeline runs the first time. In the RealWorld, things don’t always work out that way. In previous versions of the product, when a pipeline resource was badly configured, or there was an error in a query or an expression, you would sometimes discover it only when you ran your pipeline. This required you to read an error log to identify which resource caused the problem and why.
In DemoLand identifying the offending resource and fixing it is fairly straightforward because you only have a handful of resources. In RealWorld, even finding the offending resource on the pipeline canvas is challenging.
In Spring ‘12 we’ve done a number of things to improve the situation.
Components now catch many more problems at validation time – before you even run the pipeline. And the problems that are caught produce better error messages. This tells the developer which resource failed and why.
When a resource fails during pipeline execution, we mark it red and call out the specific error in a tooltip.
In DemoLand, all pipelines run quickly and produce the results you expect. In the RealWorld, pipelines can take far longer than anticipated or produce unexpected results. When you want to identify the bottleneck in a pipeline, you need to see how much time is being spent by which resource and what it is doing.
Previous versions of the product allowed the user to view aggregate statistics at the end of a pipeline run, which gave a good indicator. But what do you do when a pipeline hangs, or takes a really long time to complete? In Spring ‘12, we now show resource statistics in real time during pipeline execution in Designer.
Previous versions of the product allowed you to generate trace files showing you the value of records and they flowed through the pipeline. This enabled you to figure out why your join was not producing the result you expected. But, the trace data was written to files and required you to view the data outside of the Designer.
In Spring ‘12, you can now generate and view trace data directly within Designer.
This allows you to identify problems without having to switch tools, making debugging faster and easier.
In addition to the GUI improvements, there are many, many other improvements and bug fixes. See the release notes for a comprehensive list.
Whether we’ve achieved our “order of magnitude” goal is up to our customers to judge. But, as someone who builds a lot of pipelines, I can say that Spring ‘12 has made my life much easier.
I’m very proud of this release, and I’d encourage everyone to give it a try and send us feedback.
Continuing our series of guest posts by partners, this week we are happy to have Tara Gilliam, a lead developer at Anaplan discuss her experience in building the Anaplan Snap:
We’ve been w
orking with SnapLogic to provide Anaplan integration for a mutual customer who is a heavy user of FinancialForce, Xactly, Salesforce, Zuora and several other cloud data services. With SnapLogic’s cloud integration platform, we’ve produced a full-featured Snap, allowing customers to transfer data between Anaplan and all the data services SnapLogic already supports.
The SnapLogic platform makes it quick to start creating value. The Anaplan Snap was my first project as a new developer at Anaplan. I worked initially on uploading data from SnapLogic into Anaplan, and after starting from scratch the first beta of the Anaplan Importer was handed over for testing just 3 weeks later.
We’ve worked closely with SnapLogic to add more complexfeatures to the Anaplan Snap. We’ve had quick responses throughout, and their support has been an essential part of our Snap development success. In addition to data upload, our Snap now supports data download back into SnapLogic for processing and verification, and the ability to run independent Imports, Exports, and Actions within Anaplan. This is all supported through SnapLogic’s simple graphical Designer, allowing Anaplan workspace browsing and task configuration through drop-down selections.
The completed Snap is being delivered to SnapLogic for QA this week, and will be available shortly in their online SnapStore. We’re excited about the infinite integration possibilities now available to our customers.