UPDATED 12:01 EDT / SEPTEMBER 04 2015

NEWS

LinkedIn open-sources internal tool to simplify machine learning projects

Only three days after previewing a slew of upcoming enhancements for Apache Kafka, LinkedIn Inc. is adding another item to its open-source analytics repertoire with the release of a likewise internally-developed tool that promises to simplify machine learning initiatives. And in particular, coordination across the different stages of the project lifecycle.

Work on large-scale recommendation systems like the kind LinkedIn uses to refer members to groups and job postings that match their professional interests is typically divided between two teams. One is responsible for creating the mathematical models into which raw data is fed for analysis, while the other takes care of testing and the various other chores involved in operationalizing those models.

The problem is that even a minor change in an algorithm can have a significant impact on the work of the latter team, a reality that has traditionally required the data scientists to a make major time investment in incorporating the modifications. That slows down the rate at which new capabilities can be created and tested by a great deal, which is what Feature Fu aims to address.

The tool employs an open-source Java library called Expr to significantly cut the amount of work involved in translating changes made during the modelling process to the subsequent stages of the project. Its parser can handle updates to the formulas that dictate which parts of a given dataset are fed into an algorithm and how without requiring engineers to completely rework the underlying implementation.

Feature Fu has already been adopted by LinkedIn’s Job Relevant Team to help optimize recommendations and will now be able to find use beyond the social networking giant in other applications. Given that its other open-source projects is currently employed at over 100 organizations, including the likes of Yahoo! Inc. and The Goldman Sachs Group, Inc, the tool probably won’t have any trouble attracting users.

Photo via Geralt

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.