Large Action Models - gettectonic.com
Zendesk Launches AI Agent Builder
15Oct

The State of AI

The State of AI: How We Got Here (and What’s Next) Artificial intelligence (AI) has evolved from the realm of science fiction into a transformative force reshaping industries and lives around the world. But how did AI develop into the technology we know today, and where is it headed next? At Dreamforce, two of Salesforce’s leading minds in AI—Chief Scientist Silvio Savarese and Chief Futurist Peter Schwartz—offered insights into AI’s past, present, and future. How We Got Here: The Evolution of AI AI’s roots trace back decades, and its journey has been defined by cycles of innovation and setbacks. Peter Schwartz, Salesforce’s Chief Futurist, shared a firsthand perspective on these developments. Having been involved in AI since the 1970s, Schwartz witnessed the first “AI winter,” a period of reduced funding and interest due to the immense challenges of understanding and replicating the human brain. In the 1990s and early 2000s, AI shifted from attempting to mimic human cognition to adopting data-driven models. This new direction opened up possibilities beyond the constraints of brain-inspired approaches. By the 2010s, neural networks re-emerged, revolutionizing AI by enabling systems to process raw data without extensive pre-processing. Savarese, who began his AI research during one of these challenging periods, emphasized the breakthroughs in neural networks and their successor, transformers. These advancements culminated in large language models (LLMs), which can now process massive datasets, generate natural language, and perform tasks ranging from creating content to developing action plans. Today, AI has progressed to a new frontier: large action models. These systems go beyond generating text, enabling AI to take actions, adapt through feedback, and refine performance autonomously. Where We Are Now: The Present State of AI The pace of AI innovation is staggering. Just a year ago, discussions centered on copilots—AI systems designed to assist humans. Now, the conversation has shifted to autonomous AI agents capable of performing complex tasks with minimal human oversight. Peter Schwartz highlighted the current uncertainties surrounding AI, particularly in regulated industries like banking and healthcare. Leaders are grappling with questions about deployment speed, regulatory hurdles, and the broader societal implications of AI. While many startups in the AI space will fail, some will emerge as the giants of the next generation. Salesforce’s own advancements, such as the Atlas Reasoning Engine, underscore the rapid progress. These technologies are shaping products like Agentforce, an AI-powered suite designed to revolutionize customer interactions and operational efficiency. What’s Next: The Future of AI According to Savarese, the future lies in autonomous AI systems, which include two categories: The Road Ahead As AI continues to evolve, it’s clear that its potential is boundless. However, the path forward will require careful navigation of ethical, regulatory, and practical challenges. The key to success lies in innovation, collaboration, and a commitment to creating systems that enhance human capabilities. For Salesforce, the journey has only just begun. With groundbreaking technologies and visionary leadership, the company is not just predicting the future of AI—it’s creating it. The State of AI. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
October 15, 2024in Artificial Intelligence, Data, Salesforce, Technology
Fivetrans Hybrid Deployment
10Oct

Fivetrans Hybrid Deployment

Fivetran’s Hybrid Deployment: A Breakthrough in Data Engineering In the data engineering world, balancing efficiency with security has long been a challenge. Fivetran aims to shift this dynamic with its Hybrid Deployment solution, designed to seamlessly move data across any environment while maintaining control and flexibility. Fivetrans Hybrid Deployment. The Hybrid Advantage: Flexibility Meets Control Fivetran’s Hybrid Deployment offers a new approach for enterprises, particularly those handling sensitive data or operating in regulated sectors. Often, these businesses struggle to adopt data-driven practices due to security concerns. Hybrid Deployment changes this by enabling the secure movement of data across cloud and on-premises environments, giving businesses full control over their data while maintaining the agility of the cloud. As George Fraser, Fivetran’s CEO, notes, “Businesses no longer have to choose between managed automation and data control. They can now securely move data from all their critical sources—like Salesforce, Workday, Oracle, SAP—into a data warehouse or data lake, while keeping that data under their own control.” How it Works: A Secure, Streamlined Approach Fivetran’s Hybrid Deployment relies on a lightweight local agent to move data securely within a customer’s environment, while the Fivetran platform handles the management and monitoring. This separation of control and data planes ensures that sensitive information stays within the customer’s secure perimeter. Vinay Kumar Katta, a managing delivery architect at Capgemini, highlights the flexibility this provides, enabling businesses to design pipelines without sacrificing security. Beyond Security: Additional Benefits Hybrid Deployment’s benefits go beyond just security. It also offers: Early adopters are already seeing its value. Troy Fokken, chief architect at phData, praises how it “streamlines data pipeline processes,” especially for customers in regulated industries. AI Agent Architectures: Defining the Future of Autonomous Systems In the rapidly evolving world of AI, a new framework is emerging—AI agents designed to act autonomously, adapt dynamically, and explore digital environments. These AI agents are built on core architectural principles, bringing the next generation of autonomy to AI-driven tasks. What Are AI Agents? AI agents are systems designed to autonomously or semi-autonomously perform tasks, leveraging tools to achieve objectives. For instance, these agents may use APIs, perform web searches, or interact with digital environments. At their core, AI agents use Large Language Models (LLMs) and Foundation Models (FMs) to break down complex tasks, similar to human reasoning. Large Action Models (LAMs) Just as LLMs transformed natural language processing, Large Action Models (LAMs) are revolutionizing how AI agents interact with environments. These models excel at function calling—turning natural language into structured, executable actions, enabling AI agents to perform real-world tasks like scheduling or triggering API calls. Salesforce AI Research, for instance, has open-sourced several LAMs designed to facilitate meaningful actions. LAMs bridge the gap between unstructured inputs and structured outputs, making AI agents more effective in complex environments. Model Orchestration and Small Language Models (SLMs) Model orchestration complements LAMs by utilizing smaller, specialized models (SLMs) for niche tasks. Instead of relying on resource-heavy models, AI agents can call upon these smaller models for specific functions—such as summarizing data or executing commands—creating a more efficient system. SLMs, combined with techniques like Retrieval-Augmented Generation (RAG), allow smaller models to perform comparably to their larger counterparts, enhancing their ability to handle knowledge-intensive tasks. Vision-Enabled Language Models for Digital Exploration AI agents are becoming even more capable with vision-enabled language models, allowing them to interact with digital environments. Projects like Apple’s Ferret-UI and WebVoyager exemplify this, where agents can navigate user interfaces, recognize elements via OCR, and explore websites autonomously. Function Calling: Structured, Actionable Outputs A fundamental shift is happening with function calling in AI agents, moving from unstructured text to structured, actionable outputs. This allows AI agents to interact with systems more efficiently, triggering specific actions like booking meetings or executing API calls. The Role of Tools and Human-in-the-Loop AI agents rely on tools—algorithms, scripts, or even humans-in-the-loop—to perform tasks and guide actions. This approach is particularly valuable in high-stakes industries like healthcare and finance, where precision is crucial. The Future of AI Agents With the advent of Large Action Models, model orchestration, and function calling, AI agents are becoming powerful problem solvers. These agents are evolving to explore, learn, and act within digital ecosystems, bringing us closer to a future where AI mimics human problem-solving processes. As AI agents become more sophisticated, they will redefine how we approach digital tasks and interactions. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
October 10, 2024in Data, Enterprise, Salesforce
AI evolves with tools like Agentforce and Atlas
02Oct

AI Evolves With Agentforce and Atlas

Not long ago, financial services companies were still struggling with the challenge of customer data trapped in silos. Though it feels like a distant issue, this problem remains for many large organizations unable to integrate different divisions that deal separately with the same customers. Salesforce AI evolves with tools like Agentforce and Atlas. The solution is a concept known as a “single source of truth.” This theme took center stage at Dreamforce 2024 in San Francisco, hosted by Salesforce (NYSE). The event showcased Salesforce’s latest AI innovations, including Agentforce, which is set to revolutionize customer engagement through its advanced AI capabilities. Agentforce, which becomes generally available on October 25, enables businesses to deploy autonomous AI agents to manage a wide variety of tasks. These agents differ from earlier Salesforce-based AI tools by leveraging Atlas, a cutting-edge reasoning engine that allows the bots to think like human beings. Unlike generative AI models, which might write an email based on prompts, Agentforce’s AI agents can answer complex, high-order questions such as, “What should I do with all my customers?” The agents break down these queries into actionable steps—whether that’s sending emails, making phone calls, or texting customers—thanks to the deep capabilities of Atlas. Atlas is at the heart of what makes these AI agents so powerful. It combines multiple large language models (LLMs), large action models (LAMs), and retrieval-augmented generation (RAG) modules, along with REST APIs and connectors to various datasets. This robust system processes user queries through multiple layers, checking for validity and then expanding the query into manageable chunks for processing. Once a query passes through the chit-chat detector—which filters out non-relevant inputs—it enters the evaluation phase, where the AI determines if it has enough data to provide a meaningful answer. If not, the system loops back to the user for more information in a process Salesforce calls the agentic loop. The fewer loops required, the more efficient the AI becomes, making the experience seamless for users. Phil Mui, Senior Vice President of Salesforce AI Research, explained that the AI agents created via Agentforce are powered by the Atlas reasoning engine, which makes use of several key tools like a re-ranker, a refiner, and a response synthesizer. These tools ensure that the AI retrieves, ranks, and synthesizes relevant information to generate high-quality, natural language responses for the user. But Salesforce’s AI agents don’t stop at automation—they also emphasize trust. Before responses reach users, they go through additional checks for toxicity detection, bias prevention, and personally identifiable information (PII) masking. This ensures that the output is both accurate and safe. The potential of Agentforce is massive. According to Wedbush, Salesforce’s AI strategy could generate over $4 billion annually by 2025. Wedbush analysts recently increased their price target for Salesforce stock to $325, reflecting the strong customer reception of Agentforce’s AI ecosystem. While some analysts, such as Yiannis Zourmpanos from Seeking Alpha, have expressed caution due to Salesforce’s high valuation and slower revenue growth, the company’s continued focus on AI and multi-cloud solutions places it in a strong position for the future. Robin Fisher, Salesforce’s head of growth markets for Europe, the Middle East, and Africa, highlighted two major takeaways from Dreamforce for African businesses: the Data Cloud and AI. Data Cloud provides a 360-degree view of the customer, consolidating data into a single source of truth without requiring full data migration. Meanwhile, Agentforce’s autonomous AI agents will drive operational efficiency across industries, especially in markets like Africa. Zuko Mdwaba, Salesforce’s managing director for South Africa, added that the company’s decade-long AI journey is culminating in its most advanced AI offerings yet. This new wave of AI, he said, is transforming not just customer engagement but also internal operations, empowering employees to focus on more strategic tasks while AI handles repetitive ones. The future is clear: as AI evolves with tools like Agentforce and Atlas, businesses across sectors, from banking to retail, are poised to harness the transformative power of autonomous technology and data-driven insights, finally breaking free from the silos of the past. Like1 Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
October 2, 2024in Agentforce Platform, AI Tools, Data, Generative AI, Salesforce, Salesforce Implementation Services, Technology
Large Action Models and AI Agents
21Sep

Large Action Models and AI Agents

The introduction of LAMs marks a significant advancement in AI, focusing on actionable intelligence. By enabling robust, dynamic interactions through function calling and structured output generation, LAMs are set to redefine the capabilities of AI agents across industries.

Read More
September 21, 2024in Data
Exploring Large Action Models
05Sep

Exploring Large Action Models

Exploring Large Action Models (LAMs) for Automated Workflow Processes While large language models (LLMs) are effective in generating text and media, Large Action Models (LAMs) push beyond simple generation—they perform complex tasks autonomously. Imagine an AI that not only generates content but also takes direct actions in workflows, such as managing customer relationship management (CRM) tasks, sending emails, or making real-time decisions. LAMs are engineered to execute tasks across various environments by seamlessly integrating with tools, data, and systems. They adapt to user commands, making them ideal for applications in industries like marketing, customer service, and beyond. Key Capabilities of LAMs A standout feature of LAMs is their ability to perform function-calling tasks, such as selecting the appropriate APIs to meet user requirements. Salesforce’s xLAM models are designed to optimize these tasks, achieving high performance with lower resource demands—ideal for both mobile applications and high-performance environments. The fc series models are specifically tuned for function-calling, enabling fast, precise, and structured responses by selecting the best APIs based on input queries. Practical Examples Using Salesforce LAMs In this article, we’ll explore: Implementation: Setting Up the Model and API Start by installing the necessary libraries: pythonCopy code! pip install transformers==4.41.0 datasets==2.19.1 tokenizers==0.19.1 flask==2.2.5 Next, load the xLAM model and tokenizer: pythonCopy codeimport json import torch from transformers import AutoModelForCausalLM, AutoTokenizer model_name = “Salesforce/xLAM-7b-fc-r” model = AutoModelForCausalLM.from_pretrained(model_name, device_map=”auto”, torch_dtype=”auto”, trust_remote_code=True) tokenizer = AutoTokenizer.from_pretrained(model_name) Now, define instructions and available functions. Task Instructions: The model will use function calls where applicable, based on user questions and available tools. Format Example: jsonCopy code{ “tool_calls”: [ {“name”: “func_name1”, “arguments”: {“argument1”: “value1”, “argument2”: “value2”}} ] } Define available APIs: pythonCopy codeget_weather_api = { “name”: “get_weather”, “description”: “Retrieve weather details”, “parameters”: {“location”: “string”, “unit”: “string”} } search_api = { “name”: “search”, “description”: “Search for online information”, “parameters”: {“query”: “string”} } Creating Flask APIs for Business Logic We can use Flask to create APIs to replicate business processes. pythonCopy codefrom flask import Flask, request, jsonify app = Flask(__name__) @app.route(“/customer”, methods=[‘GET’]) def get_customer(): customer_id = request.args.get(‘customer_id’) # Return dummy customer data return jsonify({“customer_id”: customer_id, “status”: “active”}) @app.route(“/send_email”, methods=[‘GET’]) def send_email(): email = request.args.get(’email’) # Return dummy response for email send status return jsonify({“status”: “sent”}) Testing the LAM Model and Flask APIs Define queries to test LAM’s function-calling capabilities: pythonCopy codequery = “What’s the weather like in New York in fahrenheit?” print(custom_func_def(query)) # Expected: {“tool_calls”: [{“name”: “get_weather”, “arguments”: {“location”: “New York”, “unit”: “fahrenheit”}}]} Function-Calling Models in Action Using base_call_api, LAMs can determine the correct API to call and manage workflow processes autonomously. pythonCopy codedef base_call_api(query): “””Calls APIs based on LAM recommendations.””” base_url = “http://localhost:5000/” json_response = json.loads(custom_func_def(query)) api_url = json_response[“tool_calls”][0][“name”] params = json_response[“tool_calls”][0][“arguments”] response = requests.get(base_url + api_url, params=params) return response.json() With LAMs, businesses can automate and streamline tasks in complex workflows, maximizing efficiency and empowering teams to focus on strategic initiatives. Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
September 5, 2024in Data, Salesforce, Technology, Third Party Apps
Consumer Chatbot Technology
07Jun

Consumer Chatbot Technology

The Reality Behind AI Chatbots and the Path to Autonomous AI In the rush to adopt the latest Consumer Chatbot Technology, it’s easy to overlook a fundamental reality: consumer chatbot technology isn’t ready for enterprise use—and it likely never will be. The reason is simple: AI assistants are only as effective as the data that powers them. Most large language models (LLMs) are trained on data from public websites, which lack the specific business and customer data that enterprises need. This means consumer bots can’t adequately assist employees in selling products, marketing merchandise, or improving productivity, as they lack the necessary personalization and business context. To achieve the vision of AI that goes beyond simple chatbots performing basic tasks—like drafting emails, essays, blogs, or graphics—to a more advanced role where AI acts autonomously and addresses business-critical needs, a different approach is needed. This vision involves AI taking action with minimal human intervention, using digital agents to identify and respond to these needs. At Salesforce, we are pursuing a clear path to AI that not only takes action but also automates routine tasks, all while adhering to established business rules, permissions, and context. Instead of relying solely on LLMs, which primarily focus on generating human-like text, future AI assistants will depend on large action models (LAMs) that integrate decision-making and action-taking capabilities. The Journey Toward AI Autonomy Our journey towards this vision began with the Salesforce Data Cloud, a robust data engine built on the Einstein 1 Platform. This platform integrates data from across the enterprise and third-party repositories, enabling companies to activate their data, automate workflows, personalize customer interactions, and develop smarter AI solutions. Recognizing the shift from generative AI to autonomous AI, Salesforce introduced Einstein Copilot, the industry’s first conversational, enterprise-class AI assistant. Integrated across the Salesforce ecosystem, Einstein Copilot utilizes an organization’s data, whether it’s behind a firewall or in an external data lake, to act as a reasoning engine. It interprets user intents, interacts with the most suitable AI model, solves problems, generates relevant content, and provides decision-making support. Expanding the Role of AI in Business Since its launch in February 2024, Salesforce has been expanding Einstein Copilot’s library of actions to meet specific business needs in sales, service, marketing, data analysis, and industries like ecommerce, financial services, healthcare, and education. These “actions” are akin to LEGO blocks—discrete tasks that can be assembled to achieve desired project outcomes. For example, a sales representative might use Einstein Copilot to generate a personalized close plan, gain insights into why a deal may not close, or review whether pricing was discussed in a recent call. Einstein Copilot then orchestrates these tasks, provides recommendations, and compiles everything into a detailed report. The ultimate goal is for AI not only to gather and organize information but also to take proactive action. Imagine a sales representative instructing their digital agent to set up meetings with top prospects in a specific territory. The AI could not only identify suitable contacts but also suggest meeting times, plan travel schedules, draft emails, and even create talking points—all of which it could execute autonomously with the representative’s approval. Tectonic dreams of the day AI is smart enough to interpret our search engine typos and produce the results for what we were actually looking for! The Future of AI Autonomy The possibilities for semi-autonomous or fully autonomous AI are vast. As we continue to develop and refine these technologies, the potential for AI to transform business processes and decision-making becomes increasingly tangible. At Salesforce, they are committed to leading this charge, ensuring that our AI solutions not only meet but exceed the expectations of enterprises worldwide. Salesforce is in a strong position to deliver on all of them because of the volume and breadth of data housed in Data Cloud, the heavy workflow traffic in our Customer 360 CRM, and the fact we’ve delivered an enterprise-class copilot that is rapidly expanding its library of actions. It will not happen overnight. The technology needs to advance, organizations and people have to be able to trust AI and be trained to use it in the right ways, and more work will need to be done to ensure the right balance between human involvement and AI autonomy. But with our continued investment in CRM, data, and trusted AI, we will achieve that vision before too long. Salesforce is in a strong position to deliver on all of them because of the volume and breadth of data housed in Data Cloud, the heavy workflow traffic in our Customer 360 CRM, and the fact we’ve delivered an enterprise-class copilot that is rapidly expanding its library of actions. Jayesh Govindarajan, Senior Vice President, Salesforce AI Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more The Salesforce Story In Marc Benioff’s own words How did salesforce.com grow from a start up in a rented apartment into the world’s Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more

Read More
June 7, 2024in Einstein 1 Platform, Generative AI, Salesforce Data Cloud

Subscribe to our mailing list. Join our mail list to receive our newsletter

We'll keep you up to date with our latest news, insights, free resources, and much more.
Don't worry, we won't spam you.
gettectonic.com