AI EXPRESS - Hot Deal 4 VCs instabooks.co
  • AI
    Microsoft adds Image Creator to Bing, plus GPT-4 now available in Azure OpenAI Service

    Microsoft adds Image Creator to Bing, plus GPT-4 now available in Azure OpenAI Service

    Nvidia unleashes H100, its fastest AI GPU yet, across clouds and vendors

    Nvidia unleashes H100, its fastest AI GPU yet, across clouds and vendors

    Adobe bets on generative AI with 'Firefly' tool to create images from text

    Adobe bets on generative AI with ‘Firefly’ tool to create images from text

    AI professionals seek job flexibility and stability over exciting perks

    AI professionals seek job flexibility and stability over exciting perks

    Top 5 stories of the week: Generative AI dominates the news again

    Top 5 stories of the week: Generative AI dominates the news again

    With GPT-4, dangers of 'Stochastic Parrots' remain, say researchers. No wonder OpenAI CEO is a 'bit scared' | The AI Beat

    With GPT-4, dangers of ‘Stochastic Parrots’ remain, say researchers. No wonder OpenAI CEO is a ‘bit scared’ | The AI Beat

  • ML
    Accelerate Amazon SageMaker inference with C6i Intel-based Amazon EC2 instances

    Accelerate Amazon SageMaker inference with C6i Intel-based Amazon EC2 instances

    Intelligently search your organization’s Microsoft Teams data source with the Amazon Kendra connector for Microsoft Teams

    Intelligently search your organization’s Microsoft Teams data source with the Amazon Kendra connector for Microsoft Teams

    AccuShoot

    BigML is spinning out AccuShoot! –

    Announcing the Yammer connector for Amazon Kendra

    Announcing the Yammer connector for Amazon Kendra

    Bring legacy machine learning code into Amazon SageMaker using AWS Step Functions

    Bring legacy machine learning code into Amazon SageMaker using AWS Step Functions

    Maximize performance and reduce your deep learning training cost with AWS Trainium and Amazon SageMaker

    Maximize performance and reduce your deep learning training cost with AWS Trainium and Amazon SageMaker

    Grading our 2023 Oscars Machine Learning Predictions – The Official Blog of BigML.com

    Grading our 2023 Oscars Machine Learning Predictions –

    Few-click segmentation mask labeling in Amazon SageMaker Ground Truth Plus

    Few-click segmentation mask labeling in Amazon SageMaker Ground Truth Plus

    How VMware built an MLOps pipeline from scratch using GitLab, Amazon MWAA, and Amazon SageMaker

    How VMware built an MLOps pipeline from scratch using GitLab, Amazon MWAA, and Amazon SageMaker

  • NLP
    What could ChatGPT mean for Medical Affairs?

    What could ChatGPT mean for Medical Affairs?

    Want to Improve Clinical Care? Embrace Precision Medicine Through Deep Phenotyping

    Want to Improve Clinical Care? Embrace Precision Medicine Through Deep Phenotyping

    Presight AI and G42 Healthcare sign an MOU

    Presight AI and G42 Healthcare sign an MOU

    Meet Sketch: An AI code Writing Assistant For Pandas

    Meet Sketch: An AI code Writing Assistant For Pandas

    Exploring The Dark Side Of OpenAI's GPT Chatbot

    Exploring The Dark Side Of OpenAI’s GPT Chatbot

    OpenAI launches tool to catch AI-generated text

    OpenAI launches tool to catch AI-generated text

    Year end report, 1 May 2021- 30 April 2022.

    U.S. Consumer Spending Starts to Sputter; Labor Report to Give Fed Look at Whether Rate Increases Are Cooling Rapid Wage Growth

    Meet ETCIO SEA Transformative CIOs 2022 Winner Edmund Situmorang, CIOSEA News, ETCIO SEA

    Meet ETCIO SEA Transformative CIOs 2022 Winner Edmund Situmorang, CIOSEA News, ETCIO SEA

    His Highness Sheikh Theyab bin Zayed Al Nahyan witnesses MBZUAI inaugural commencement

    His Highness Sheikh Theyab bin Zayed Al Nahyan witnesses MBZUAI inaugural commencement

  • Vision
    NVIDIA Metropolis Ecosystem Grows With Advanced Development Tools to Accelerate Vision AI

    NVIDIA Metropolis Ecosystem Grows With Advanced Development Tools to Accelerate Vision AI

    Low Code and No Code Platforms for AI and Computer Vision

    Low Code and No Code Platforms for AI and Computer Vision

    Computer Vision Model Performance Evaluation (Guide 2023)

    Computer Vision Model Performance Evaluation (Guide 2023)

    PepsiCo Leads in AI-Powered Automation With KoiVision Platform

    PepsiCo Leads in AI-Powered Automation With KoiVision Platform

    USB3 & GigE Frame Grabbers for Machine Vision

    USB3 & GigE Frame Grabbers for Machine Vision

    Active Learning in Computer Vision - Complete 2023 Guide

    Active Learning in Computer Vision – Complete 2023 Guide

    Ensembling Neural Network Models With Tensorflow

    Ensembling Neural Network Models With Tensorflow

    Autoencoder in Computer Vision - Complete 2023 Guide

    Autoencoder in Computer Vision – Complete 2023 Guide

    CVAT: Computer Vision Annotation Tool - 2023 Guide

    CVAT: Computer Vision Annotation Tool – 2023 Guide

  • Robotics
    amazon robots in a simulated world.

    NVIDIA is making AI easier to use

    Clearpath Robotics announces Husky Observer

    Clearpath Robotics announces Husky Observer

    OTTO Motors launches OTTO 600 and improved software

    OTTO Motors launches OTTO 600 and improved software

    Locus Robotics surpasses 1 billion units picks

    Locus Robotics introduces LocusONE multi-bot warehouse management

    Slip Robotics launches new trailer pallet unloading solution

    Slip Robotics launches new trailer pallet unloading solution

    MiR Insights software for its AMRs

    MiR Insights cloud-based software optimizes AMR fleets

    a large industrial robot arm from ABB Robotics

    ABB spending $20M to expand U.S. robotics factory

    Jeff Cardenas robotics summit.

    Learn about developing general purpose robots

    Advanced Construction Robotics launches rebar lifting robot

    Advanced Construction Robotics launches rebar lifting robot

  • RPA
    Benefits of Automated Claims Processing in Insurance Industry

    Benefits of Automated Claims Processing in Insurance Industry

    ChatGPT and RPA Join Force to Create a New Tech-Revolution

    ChatGPT and RPA Join Force to Create a New Tech-Revolution

    How does RPA in Accounts Payable Enhance Data Accuracy?

    How does RPA in Accounts Payable Enhance Data Accuracy?

    10 Best Use Cases to Automate using RPA in 2023

    10 Best Use Cases to Automate using RPA in 2023

    How will RPA Improve the Employee Onboarding Process?

    How will RPA Improve the Employee Onboarding Process?

    Key 2023 Banking Automation Trends / Blogs / Perficient

    Key 2023 Banking Automation Trends / Blogs / Perficient

    AI-Driven Omnichannel is the Future of Insurance Industry

    AI-Driven Omnichannel is the Future of Insurance Industry

    Avoid Patient Queues with Automated Query Resolution

    Avoid Patient Queues with Automated Query Resolution

    RPA in Banking & Finance 2023 (Use Cases, Benefits, Challenges, Trends)

    RPA in Banking & Finance 2023 (Use Cases, Benefits, Challenges, Trends)

  • Gaming
    God of War Ragnarok had a banner debut week at UK retail

    God of War Ragnarok had a banner debut week at UK retail

    A Little To The Left Review (Switch eShop)

    A Little To The Left Review (Switch eShop)

    Horizon Call of the Mountain will release alongside PlayStation VR2 in February

    Horizon Call of the Mountain will release alongside PlayStation VR2 in February

    Sonic Frontiers has Dreamcast-era jank and pop-in galore - but I can't stop playing it

    Sonic Frontiers has Dreamcast-era jank and pop-in galore – but I can’t stop playing it

    Incredible November Xbox Game Pass addition makes all other games obsolete

    Incredible November Xbox Game Pass addition makes all other games obsolete

    Free Monster Hunter DLC For Sonic Frontiers Now Available On Switch

    Free Monster Hunter DLC For Sonic Frontiers Now Available On Switch

    Somerville review: the most beautiful game I’ve ever played

    Somerville review: the most beautiful game I’ve ever played

    Microsoft Flight Sim boss confirms more crossover content like Halo's Pelican and Top Gun Maverick

    Microsoft Flight Sim boss confirms more crossover content like Halo’s Pelican and Top Gun Maverick

    The Game Awards nominations are in, with God of War Ragnarok up for 10 of them

    The Game Awards nominations are in, with God of War Ragnarok up for 10 of them

  • Investment
    Rain

    Rain Raises $116M in Funding

    Homebot

    Homebot Acquires Quo

    Gravie

    Gravie Raises $179M In Growth Funding – FinSMEs

    Placemakr Raises $65M in Funding

    Placemakr Raises $65M in Funding

    tomi

    tomi Raises $40M in Funding Round

    Mindset Health

    Mindset Health Raises US$12M in Funding

    structshare

    StructShare Raises $8M in Funding

    Janus Logo

    Janus Receives Growth Investment from Enhanced Healthcare Partners

    Wingtra

    Wingtra Raises $22M in Funding

  • More
    • Data analytics
    • Apps
    • No Code
    • Cloud
    • Quantum Computing
    • Security
    • AR & VR
    • Esports
    • IOT
    • Smart Home
    • Smart City
    • Crypto Currency
    • Blockchain
    • Reviews
    • Video
No Result
View All Result
AI EXPRESS - Hot Deal 4 VCs instabooks.co
No Result
View All Result
Home AI

Open source NLP is fueling a new wave of startups

seprameen by seprameen
December 23, 2021
in AI
0
0
SHARES
1
VIEWS
Share on FacebookShare on Twitter

Hear from CIOs, CTOs, and different C-level and senior execs on information and AI methods on the Way forward for Work Summit this January 12, 2022. Be taught extra


Let the OSS Enterprise e-newsletter information your open supply journey! Sign up here.

Giant language fashions able to writing poems, summaries, and pc code are driving the demand for “pure language processing (NLP) as a service.” As these fashions grow to be extra succesful — and accessible, comparatively talking — urge for food within the enterprise for them is rising. In keeping with a 2021 survey from John Snow Labs and Gradient Move, 60% of tech leaders indicated that their NLP budgets grew by not less than 10% in comparison with 2020, whereas a 3rd — 33% — mentioned that their spending climbed by greater than 30%.

Properly-resourced suppliers like OpenAI, Cohere, and AI21 Labs are reaping the advantages. As of March, OpenAI said that GPT-3 was being utilized in greater than 300 totally different apps by “tens of 1000’s” of builders and producing 4.5 billion phrases per day. Traditionally, coaching and deploying these fashions was past the attain of startups with out substantial capital — to not point out compute sources. However the emergence of open supply NLP fashions, datasets, and infrastructure is democratizing the expertise in shocking methods.

Open supply NLP

The hurdles to creating a state-of-the-art language mannequin are vital. These with the sources to develop and practice them, like OpenAI, usually select to not open-source their methods in favor of commercializing them (or solely licensing them). However even the fashions that are open-sourced require immense compute sources to commercialize.

Take, for instance, Megatron 530B, which was collectively created and launched by Microsoft and Nvidia. The mannequin was initially skilled throughout 560 Nvidia DGX A100 servers, every internet hosting 8 Nvidia A100 80GB GPUs. Microsoft and Nvidia say that they noticed between 113 and 126 teraflops per second per GPU whereas coaching Megatron 530B, which might put the coaching price within the hundreds of thousands of {dollars}. (A teraflop score measures the efficiency of {hardware}, together with GPUs.)

Inference — truly operating the skilled mannequin — is one other problem. Getting inferencing (e.g., sentence autocompletion) time with Megatron 530B all the way down to a half a second requires the equal of two $199,000 Nvidia DGX A100 methods. Whereas cloud alternate options could be cheaper, they’re not dramatically so — one estimate pegs the price of operating GPT-3 on a single Amazon Net Providers occasion at a minimal of $87,000 per yr.

Lately, nonetheless, open analysis efforts like EleutherAI have lowered the boundaries to entry. A grassroots assortment of AI researchers, EleutherAI goals to ultimately ship the code and datasets wanted to run a mannequin comparable (although not equivalent) to GPT-3. The group has already launched a dataset known as The Pile that’s designed to coach giant language fashions to finish textual content, write code, and extra. (By the way, Megatron 530B was skilled on The Pile.) And in June, EleutherAI made obtainable below the Apache 2.0 license GPT-Neo and its successor, GPT-J, a language mannequin that performs almost on par with an equivalent-sized GPT-3 mannequin.

One of many startups serving EleutherAI’s fashions as a service is NLP Cloud, which was based a yr in the past by Julien Salinas, a former software program engineer at Hunter.io and the founding father of money-lending service StudyLink.fr. Salinas says the concept got here to him when he realized that, as a programmer, it was turning into and simpler to leverage open supply NLP fashions for enterprise functions however tougher to get them to run correctly in manufacturing.

NLP Cloud

Above: NLP Cloud’s mannequin dashboard.

Picture Credit score: NLP Cloud

NLP Cloud — which has 5 workers — hasn’t raised cash from exterior traders, however claims to be worthwhile.

See also  Metaphysic partners with CAA to develop generative AI for creative artists

“Our buyer base is rising quickly, and we see very numerous clients utilizing NLP Cloud — from freelancers to startups and larger tech firms,” Salinas instructed VentureBeat by way of electronic mail. “For instance, we’re at the moment serving to a buyer create a programming professional AI that doesn’t code for you, however — much more importantly— offers you superior details about particular technical fields that you could leverage when creating your software (e.g., as a Go developer, you would possibly wish to learn to use goroutines). We’ve one other buyer who fine-tuned his personal model of GPT-J on NLP Cloud to be able to make medical summaries of conversations between medical doctors and sufferers.”

NLP Cloud competes with Neuro, which serves fashions by way of an API together with EleutherAI’s GPT-J on a pay-per-use foundation. Pursuing higher effectivity, Neuro says it runs a lighter-weight model of GPT-J that also produces “sturdy outcomes” for functions like producing advertising and marketing copy. In one other cost-saving measure, Neuro additionally has clients share cloud GPUs, the ability consumption of which the corporate caps under a sure stage.

“Buyer development has been good. We’ve had many customers put us into their manufacturing surroundings with out having spoken with them — which is wonderful for an enterprise product,” CEO Paul Hetherington instructed VentureBeat by way of electronic mail. “Some individuals have spent over $1,000 of their first day of utilization with integration occasions of minutes in lots of situations. We’ve clients utilizing GPT-J … in quite a lot of methods, together with market copy, producing tales and articles, and producing dialogue for characters in video games or chatbots.”

Neuro, which claims to run all of its compute in-house, has an 11-person group and not too long ago graduated from Y Combinator’s Winter 2021 cohort. Hetherington says that the plan is to proceed to construct out its cloud community and to develop its relationship with EleutherAI.

Neuro

One other EleutherAI mannequin adopter is CoreWeave, which additionally works intently with EleutherAI to coach the group’s bigger fashions. CoreWeave, a cloud service supplier that originally centered on cryptocurrency mining, says that serving NLP fashions is its “largest use case thus far” and at the moment works with clients together with Novel AI, whose AI-powered platform helps customers create tales and embark on text-based adventures.

“We’ve leaned into NLP due to the scale of the market and the void we fill as a cloud supplier,” CoreWeave cofounder and CTO Brian Venturo instructed VentureBeat by way of electronic mail. “I feel we’ve been actually profitable right here due to the infrastructure we constructed, and the price benefits our purchasers see on CoreWeave in comparison with opponents.”

See also  How visual data is propelling a new wave of climate tech

Bias points

No language mannequin is proof against bias and toxicity, as analysis has repeatedly proven. Bigger NLP-as-a-service suppliers have taken a spread of approaches in trying to mitigate the results, from consulting exterior advisory councils to implementing filters that stop clients from utilizing the fashions to generate sure content material, like that pertaining to self-harm.

On the dataset stage, EleutherAI claims to have carried out “intensive bias evaluation” on The Pile and made “powerful editorial choices” to exclude information that they felt have been “unacceptably negatively biased” towards sure teams or views.

NLP Cloud permits clients to add a blacklist of phrases to scale back the danger of producing offending content material with its hosted fashions. In an effort to protect the integrity of the unique fashions, flaws and all, the corporate hasn’t deployed filters or tried to detoxify any of the fashions it serves. However Salinas says that if NLP Cloud does make modifications sooner or later, it’ll be clear about the truth that it has executed so.

“An important threat of toxicity comes from GPT-J as it’s a highly effective AI mannequin for textual content technology, so it must be used responsibly,” Salinas mentioned.

Neither NLP Cloud nor Neuro explicitly prohibit clients from utilizing fashions for probably problematic use circumstances — though each reserve the precise to revoke entry to the fashions for any motive. CoreWeave, for its half, believes that not policing its clients’ functions is a promoting level of its service — however advocates for basic “AI security.”

“[O]ur purchasers fine-tune fashions [to, for instance, reduce toxicity] commonly. This empowers them to ‘re-train’ giant language fashions on a comparatively small information set to make the mannequin extra related to their use case,” Venturo continued. “We don’t at the moment have an out-of-the-box resolution for purchasers to do that, however I’d anticipate that to alter within the coming weeks.”

Hetherington notes that Neuro additionally provides fine-tuning capabilities “with little-to-no programming experience required.”

The trail ahead

Whereas the hands-off method to mannequin moderation won’t sit effectively with each buyer, startups like NLP Cloud, Neuro, and CoreWeave argue that they’re making NLP expertise extra accessible than their better-funded rivals.

For instance, on NLP Cloud, the plan for 3 requests per minute utilizing GPT-J prices $29 per 30 days on a cloud CPU or $99 per 30 days on a GPU — regardless of the variety of tokens (i.e., phrases). Against this, OpenAI fees on a per-token foundation. In the direction of Knowledge Science compared OpenAI’s and NLP Cloud’s choices and located {that a} buyer providing an essay-generating app that receives 10 requests each minute must pay round $2,850 per 30 days in the event that they used one among OpenAI’s less-capable fashions (Curie) versus $699 with NLP Cloud.

Startups constructed on open supply fashions like EleutherAI’s might drive the following wave of NLP adoption. Advisory agency Mordor Intelligence forecasts that the NLP market will greater than triple its income by 2025, as enterprise curiosity in AI rises.

“Deploying these fashions effectively so we will keep an inexpensive pricing, whereas making them dependable with none interruption, is a problem. [But the goal is to provide] a method for builders and information scientists to profit from NLP in manufacturing with out worrying about DevOps,” Salinas mentioned.

Source link

Tags: FuelingNLPopensourceStartupswave
Previous Post

Deep Learning Mask Detection Training Tutorial

Next Post

Healthcare PowerByte: Enhancing Efficiency, Value, and Care

seprameen

seprameen

Next Post
Healthcare PowerByte: Enhancing Efficiency, Value, and Care

Healthcare PowerByte: Enhancing Efficiency, Value, and Care

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Newsletter

Popular Stories

  • Image showing premature baby

    Preterm babies do not habituate to repeated pain like other babies do

    0 shares
    Share 0 Tweet 0
  • Children’s mental health declines as a result of mothers forced to find job

    0 shares
    Share 0 Tweet 0
  • Need Windows on a really old PC? New Tiny10 has arrived (complete with tighter security)

    0 shares
    Share 0 Tweet 0
  • Microsoft lays off AI ethics team

    0 shares
    Share 0 Tweet 0
  • Burnsed Trucking Closes Capital Raise

    0 shares
    Share 0 Tweet 0

Artificial Intelligence Jobs

View 115 AI Jobs at Tesla

View 165 AI Jobs at Nvidia

View 105 AI Jobs at Google

View 135 AI Jobs at Amamzon

View 131 AI Jobs at IBM

View 95 AI Jobs at Microsoft

View 205 AI Jobs at Meta

View 192 AI Jobs at Intel

Accounting and Finance Hub

Raised Seed, Series A, B, C Funding Round

Get a Free Insurance Quote

Try Our Accounting Service

AI EXPRESS – Hot Deal 4 VCs instabooks.co

AI EXPRESS is a news site that covers the latest developments in Artificial Intelligence, Data Analytics, ML & DL, Algorithms, RPA, NLP, Robotics, Smart Homes & Cities, Cloud & Quantum Computing, AR & VR and Blockchains

Categories

  • AI
  • Ai videos
  • Apps
  • AR & VR
  • Blockchain
  • Cloud
  • Computer Vision
  • Crypto Currency
  • Data analytics
  • Esports
  • Gaming
  • Gaming Videos
  • Investment
  • IOT
  • Iot Videos
  • Low Code No Code
  • Machine Learning
  • NLP
  • Quantum Computing
  • Robotics
  • Robotics Videos
  • RPA
  • Security
  • Smart City
  • Smart Home

Quick Links

  • Reviews
  • Deals
  • Best
  • AI Jobs
  • AI Events
  • AI Directory
  • Industries

© 2021 Aiexpress.io - All rights reserved.

  • Contact
  • Privacy Policy
  • Terms & Conditions

No Result
View All Result
  • AI
  • ML
  • NLP
  • Vision
  • Robotics
  • RPA
  • Gaming
  • Investment
  • More
    • Data analytics
    • Apps
    • No Code
    • Cloud
    • Quantum Computing
    • Security
    • AR & VR
    • Esports
    • IOT
    • Smart Home
    • Smart City
    • Crypto Currency
    • Blockchain
    • Reviews
    • Video

© 2021 Aiexpress.io - All rights reserved.