Meta Archives - gettectonic.com
Standards in Healthcare Cybersecurity

Deploying Large Language Models in Healthcare

Study Identifies Cost-Effective Strategies for Deploying Large Language Models in Healthcare Efficient deployment of large language models (LLMs) at scale in healthcare can streamline clinical workflows and reduce costs by up to 17 times without compromising reliability, according to a study published in NPJ Digital Medicine by researchers at the Icahn School of Medicine at Mount Sinai. The research highlights the potential of LLMs to enhance clinical operations while addressing the financial and computational hurdles healthcare organizations face in scaling these technologies. To investigate solutions, the team evaluated 10 LLMs of varying sizes and capacities using real-world patient data. The models were tested on chained queries and increasingly complex clinical notes, with outputs assessed for accuracy, formatting quality, and adherence to clinical instructions. “Our study was driven by the need to identify practical ways to cut costs while maintaining performance, enabling health systems to confidently adopt LLMs at scale,” said Dr. Eyal Klang, director of the Generative AI Research Program at Icahn Mount Sinai. “We aimed to stress-test these models, evaluating their ability to manage multiple tasks simultaneously and identifying strategies to balance performance and affordability.” The team conducted over 300,000 experiments, finding that high-capacity models like Meta’s Llama-3-70B and GPT-4 Turbo 128k performed best, maintaining high accuracy and low failure rates. However, performance began to degrade as task volume and complexity increased, particularly beyond 50 tasks involving large prompts. The study further revealed that grouping tasks—such as identifying patients for preventive screenings, analyzing medication safety, and matching patients for clinical trials—enabled LLMs to handle up to 50 simultaneous tasks without significant accuracy loss. This strategy also led to dramatic cost savings, with API costs reduced by up to 17-fold, offering a pathway for health systems to save millions annually. “Understanding where these models reach their cognitive limits is critical for ensuring reliability and operational stability,” said Dr. Girish N. Nadkarni, co-senior author and director of The Charles Bronfman Institute of Personalized Medicine. “Our findings pave the way for the integration of generative AI in hospitals while accounting for real-world constraints.” Beyond cost efficiency, the study underscores the potential of LLMs to automate key tasks, conserve resources, and free up healthcare providers to focus more on patient care. “This research highlights how AI can transform healthcare operations. Grouping tasks not only cuts costs but also optimizes resources that can be redirected toward improving patient outcomes,” said Dr. David L. Reich, co-author and chief clinical officer of the Mount Sinai Health System. The research team plans to explore how LLMs perform in live clinical environments and assess emerging models to determine whether advancements in AI technology can expand their cognitive thresholds. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more Alphabet Soup of Cloud Terminology As with any technology, the cloud brings its own alphabet soup of terms. This insight will hopefully help you navigate Read more

Read More
Meta Joins the Race to Reinvent Search with AI

Meta Joins the Race to Reinvent Search with AI

Meta Joins the Race to Reinvent Search with AI Meta, the parent company of Facebook, Instagram, and WhatsApp, is stepping into the evolving AI-driven search landscape. As vendors increasingly embrace generative AI to transform search experiences, Meta aims to challenge Google’s dominance in this space. The company is reportedly developing an AI-powered search engine designed to provide conversational, AI-generated summaries of recent events and news. These summaries would be delivered via Meta’s AI chatbot, supported by a multiyear partnership with Reuters for real-time news insights, according to The Information. AI Search: A Growing Opportunity The push comes as generative AI reshapes search technology across the industry. Google, the long-standing leader, has integrated AI features such as AI Overviews into its search platform, offering users summarized search results, product comparisons, and more. This feature, now available in over 100 countries as of October 2024, signals a shift in traditional search strategies. Similarly, OpenAI, the creator of ChatGPT, has been exploring its own AI search model, SearchGPT, and forging partnerships with media organizations like the Associated Press and Hearst. However, OpenAI faces legal challenges, such as a lawsuit from The New York Times over alleged copyright infringement. Meta’s entry into AI-powered search aligns with a broader trend among tech giants. “It makes sense for Meta to explore this,” said Mark Beccue, an analyst with TechTarget’s Enterprise Strategy Group. He noted that Meta’s approach seems more targeted at consumer engagement than enterprise solutions, particularly appealing to younger audiences who are shifting away from traditional search behaviors. Shifting User Preferences Generational changes in search habits are creating opportunities for new players in the market. Younger users, particularly Gen Z and Gen Alpha, are increasingly turning to platforms like TikTok for lifestyle advice and Amazon for product recommendations, bypassing traditional search engines like Google. “Recent studies show younger generations are no longer using ‘Google’ as a verb,” said Lisa Martin, an analyst with the Futurum Group. “This opens the playing field for competitors like Meta and OpenAI.” Forrester Research corroborates this trend, noting a diversification in search behaviors. “ChatGPT’s popularity has accelerated this shift,” said Nikhil Lai, a Forrester analyst. He added that these changes could challenge Google’s search ad market, with its dominance potentially waning in the years ahead. Meta’s AI Search Potential Meta’s foray into AI search offers an opportunity to enhance user experiences and deepen engagement. Rather than pushing news content into users’ feeds—an approach that has drawn criticism—AI-driven search could empower users to decide what content they see and when they see it. “If implemented thoughtfully, it could transform the user experience and give users more control,” said Martin. This approach could also boost engagement by keeping users within Meta’s ecosystem. The Race for Revenue and Trust While AI-powered search is expected to increase engagement, monetization strategies remain uncertain. Google has yet to monetize its AI Overviews, and OpenAI’s plans for SearchGPT remain unclear. Other vendors, like Perplexity AI, are experimenting with models such as sponsored questions instead of traditional results. Trust remains a critical factor in the evolving search landscape. “Google is still seen as more trustworthy,” Lai noted, with users often returning to Google to verify AI-generated information. Despite the competition, the conversational AI search market lacks a definitive leader. “Google dominated traditional search, but the race for conversational search is far more open-ended,” Lai concluded. Meta’s entry into this competitive space underscores the ongoing evolution of search technology, setting the stage for a reshaped digital landscape driven by AI innovation. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
Transforming the Role of Data Science Teams

Transforming the Role of Data Science Teams

GenAI: Transforming the Role of Data Science Teams Challenges, Opportunities, and the Evolving Responsibilities of Data Scientists Generative AI (GenAI) is revolutionizing the AI landscape, offering faster development cycles, reduced technical overhead, and enabling groundbreaking use cases that once seemed unattainable. However, it also introduces new challenges, including the risks of hallucinations and reliance on third-party APIs. For Data Scientists and Machine Learning (ML) teams, this shift directly impacts their roles. GenAI-driven projects, often powered by external providers like OpenAI, Anthropic, or Meta, blur traditional lines. AI solutions are increasingly accessible to non-technical teams, but this accessibility raises fundamental questions about the role and responsibilities of data science teams in ensuring effective, ethical, and future-proof AI systems. Let’s explore how this evolution is reshaping the field. Expanding Possibilities Without Losing Focus While GenAI unlocks opportunities to solve a broader range of challenges, not every problem warrants an AI solution. Data Scientists remain vital in assessing when and where AI is appropriate, selecting the right approaches—whether GenAI, traditional ML, or hybrid solutions—and designing reliable systems. Although GenAI broadens the toolkit, two factors shape its application: For example, incorporating features that enable user oversight of AI outputs may prove more strategic than attempting full automation with extensive fine-tuning. Differentiation will not come from simply using LLMs, which are widely accessible, but from the unique value and functionality they enable. Traditional ML Is Far from Dead—It’s Evolving with GenAI While GenAI is transformative, traditional ML continues to play a critical role. Many use cases, especially those unrelated to text or images, are best addressed with ML. GenAI often complements traditional ML, enabling faster prototyping, enhanced experimentation, and hybrid systems that blend the strengths of both approaches. For instance, traditional ML workflows—requiring extensive data preparation, training, and maintenance—contrast with GenAI’s simplified process: prompt engineering, offline evaluation, and API integration. This allows rapid proof of concept for new ideas. Once proven, teams can refine solutions using traditional ML to optimize costs or latency, or transition to Small Language Models (SMLs) for greater control and performance. Hybrid systems are increasingly common. For example, DoorDash combines LLMs with ML models for product classification. LLMs handle cases the ML model cannot classify confidently, retraining the ML system with new insights—a powerful feedback loop. GenAI Solves New Problems—But Still Needs Expertise The AI landscape is shifting from bespoke in-house models to fewer, large multi-task models provided by external vendors. While this simplifies some aspects of AI implementation, it requires teams to remain vigilant about GenAI’s probabilistic nature and inherent risks. Key challenges unique to GenAI include: Data Scientists must ensure robust evaluations, including statistical and model-based metrics, before deployment. Monitoring tools like Datadog now offer LLM-specific observability, enabling teams to track system performance in real-world environments. Teams must also address ethical concerns, applying frameworks like ComplAI to benchmark models and incorporating guardrails to align outputs with organizational and societal values. Building AI Literacy Across Organizations AI literacy is becoming a critical competency for organizations. Beyond technical implementation, competitive advantage now depends on how effectively the entire workforce understands and leverages AI. Data Scientists are uniquely positioned to champion this literacy by leading initiatives such as internal training, workshops, and hackathons. These efforts can: The New Role of Data Scientists: A Strategic Pivot The role of Data Scientists is not diminishing but evolving. Their expertise remains essential to ensure AI solutions are reliable, ethical, and impactful. Key responsibilities now include: By adapting to this new landscape, Data Scientists will continue to play a pivotal role in guiding organizations to harness AI effectively and responsibly. GenAI is not replacing them; it’s expanding their impact. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more Top Ten Reasons Why Tectonic Loves the Cloud The Cloud is Good for Everyone – Why Tectonic loves the cloud You don’t need to worry about tracking licenses. Read more

Read More
gettectonic.com