Use this to analyze and understand multiple images using Claude's vision capabilities. If you have local image files, you can use generate_tmp_public_url tool multiple times to get public URLs first: 1. Call generate_tmp_public_url for each local image file 2. Collect all returned URLs into a list 3. Use the list of URLs as the img_urls parameter for this function Data Visualization Integration: When the user's input indicates a need for comparison or data visualization (e.g., "compare the values in these charts", "extract and plot the data from these images"), this function can return data in a format suitable for Plotly visualization. The returned data will be a dictionary with a special key "__plotly_data__" containing: { "__plotly_data__": { "data": [...], # Plotly data array "layout": {...} # Plotly layout object } } You can then pass this data to create_plotly_chart to generate an interactive chart. Supported image formats: - JPEG, PNG, GIF, WebP - Maximum file size: 5MB per image - Recommended size: No more than 1568 pixels in either dimension - Very small images (under 200 pixels) may degrade performance - Can analyze up to 20 images per request Capabilities: - Analyzing charts, graphs, and diagrams - Reading and understanding text in images - Describing visual content and scenes - Comparing multiple images in a single request - Answering questions about image details - Identifying relationships between images - Extracting data from charts for visualization Limitations: - Cannot identify or name specific people - May have reduced accuracy with low-quality or very small images - Limited spatial reasoning abilities - Cannot verify if images are AI-generated - Not designed for medical diagnosis or healthcare applications Args: img_urls: List of URLs to the image files (can be generated using generate_tmp_public_url for local files) user_input: Question or instruction about the image content(s) Returns: str: Claude's analysis of the image(s) based on the query, or Plotly-compatible data structure if visualization is needed

Use this to chat with a PDF file. User can ask about any text, pictures, charts, and tables in PDFs that is provided. Some sample use cases: - Analyzing financial reports and understanding charts/tables - Extracting key information from legal documents - Translation assistance for documents - Converting document information into structured formats Data Visualization Integration: When the user's input indicates a need for comparison or data visualization (e.g., "compare the quarterly profits", "show the trend of sales"), this function can return data in a format suitable for Plotly visualization. The returned data will be a dictionary with a special key "__plotly_data__" containing: { "__plotly_data__": { "data": [...], # Plotly data array "layout": {...} # Plotly layout object } } You can then pass this data to create_plotly_chart to generate an interactive chart. If you have a local PDF file, you can use generate_tmp_public_url tool to get a public URL first: 1. Call generate_tmp_public_url with your local PDF file path 2. Use the returned URL as the pdf_url parameter for this function Args: pdf_url: the URL to the PDF file (can be generated using generate_tmp_public_url for local files) user_input: the user's input Returns: str: Analysis result or Plotly-compatible data structure if visualization is needed

Create a custom HTML page and return its URL. This URL should be provided to the user, as they will need to access it to view the HTML content in their web browser. 這個工具支援完整的HTML文檔，包括JavaScript和CSS，可以用來創建複雜的互動式頁面。 使用 create_html_page 的情境： - 需要展示自定義的HTML內容 - 需要嵌入複雜的互動式內容 - 需要製作自訂格式的報告或文件 - 需要使用第三方JavaScript庫 - 需要展示表格、圖像和多媒體內容 - 需要創建結構化且易於閱讀的内容呈現 - 需要使用CSS樣式創建美觀的界面 - 需要嵌入特殊的圖表或視覺元素 Input Options: You can pass either: 1. A complete HTML document with doctype, html, head, and body tags 2. An HTML fragment that will be automatically wrapped in a basic HTML structure Supported HTML Features: - Complete HTML documents with your own structure - Custom JavaScript for interactive elements - Custom CSS for styling and layout - External libraries and frameworks (via CDN) - Tables, lists, and other structural elements - Embedded images and multimedia (via URLs) - Form elements (though they won't submit data) - Responsive design elements - Unicode and international text support Security Considerations: - HTML content is sandboxed in the browser - Cannot access user's device or data - External resources must be from trusted sources - No server-side processing capability - No personal data should be included in the HTML Example of complete HTML document: ```html ``` Example of HTML fragment (will be auto-wrapped): ```html ``` Args: html_content: Complete HTML document or fragment. Can include JavaScript, CSS, and other elements. title: Optional title for the HTML page. If provided, must be in Traditional Chinese. For example: "客戶報告" instead of "Client Report" Note: This is only used if the HTML content doesn't already have a title. Returns: str: URL for the HTML page. This URL should be provided to the user, as they will need to access it to view the content in their web browser.

Create an interactive Mermaid diagram visualization and return its URL. This URL should be provided to the user, as they will need to access it to view the interactive diagram in their web browser. 使用 create_mermaid_diagram 的情境： - 提到「流程圖」、「架構圖」、「關係圖」等字眼 - 需要展示系統架構（flowchart） - 需要說明操作流程（flowchart） - 需要展示時序互動（sequence diagram） - 需要展示狀態轉換（state diagram） - 需要展示類別關係（class diagram） - 需要展示實體關係（ER diagram） - 需要展示專案時程（gantt chart） - 需要展示使用者旅程（journey） - 需要展示需求關係（requirement diagram） - 需要展示資源分配（pie chart） Supported Diagram Types: 1. Flowcharts (graph TD/LR): - System architectures - Process flows - Decision trees - Data flows 2. Sequence Diagrams (sequenceDiagram): - API interactions - System communications - User interactions - Message flows 3. Class Diagrams (classDiagram): - Software architecture - Object relationships - System components - Code structure 4. State Diagrams (stateDiagram-v2): - System states - Workflow states - Process states - State transitions 5. Entity Relationship Diagrams (erDiagram): - Database schemas - Data relationships - System entities - Data models 6. User Journey Diagrams (journey): - User experiences - Customer flows - Process steps - Task sequences 7. Gantt Charts (gantt): - Project timelines - Task schedules - Resource allocation - Milestone tracking 8. Pie Charts (pie): - Data distribution - Resource allocation - Market share - Component breakdown 9. Requirement Diagrams (requirementDiagram): - System requirements - Dependencies - Specifications - Constraints Example Mermaid syntax for a simple flowchart: ``` graph TD A[開始] --> B{是否有資料?} B -->|是| C[處理資料] B -->|否| D[取得資料] C --> E[結束] D --> B ``` Args: mermaid_data: String containing the Mermaid diagram definition title: Optional title for the diagram. If provided, must be in Traditional Chinese. For example: "系統流程圖" instead of "System Flowchart" Returns: str: URL for the interactive HTML visualization. This URL should be provided to the user, as they will need to access it to view the interactive diagram in their web browser.

Create an interactive Plotly visualization and return its URL. This URL should be provided to the user, as they will need to access it to view the interactive chart in their web browser. 使用 create_plotly_chart 的情境： - 提到「圖表」、「統計圖」、「視覺化」等字眼 - 需要呈現數據趨勢（折線圖） - 需要比較數值（長條圖、圓餅圖） - 需要展示分布情況（散點圖、熱力圖） - 需要顯示時間序列資料（時間軸圖） - 需要展示地理資訊（地圖） - 需要多維度資料分析（3D圖、氣泡圖） - 需要展示統計分布（箱型圖） - 需要展示累積趨勢（面積圖） - 需要互動式資料探索 Integration with Other Tools: This function can be used in conjunction with chat_with_imgs and chat_with_pdf when they return data suitable for visualization. When those tools detect a need for visualization, they will return a JSON string with a "__plotly_data__" key, which can be directly passed to this function. Example workflow: 1. User asks to analyze and visualize data from images/PDFs 2. chat_with_imgs or chat_with_pdf returns JSON string with "__plotly_data__" key 3. Pass that string to this function to get an interactive visualization URL Supported Chart Types: - Line charts: For showing trends and time series data - Bar charts: For comparing values across categories - Pie charts: For showing proportions of a whole - Scatter plots: For showing relationships between variables - Heat maps: For showing patterns in matrix data - Box plots: For showing statistical distributions - Geographic maps: For showing spatial data - 3D plots: For showing three-dimensional data - Bubble charts: For showing three variables in 2D - Area charts: For showing cumulative totals over time The figure_data should be a JSON string containing plotly figure specifications with 'data' and 'layout'. Example: { 'data': [{ 'type': 'scatter', 'x': [1, 2, 3, 4], 'y': [10, 15, 13, 17] }], 'layout': { 'title': 'My Plot' } } Args: figure_data: JSON string containing plotly figure specifications or output from chat_with_imgs/chat_with_pdf. Will be parsed using json.loads(). title: Optional title for the plot. If provided, must be in Traditional Chinese. For example: "台灣人口統計圖表" instead of "Taiwan Population Chart" Returns: str: URL for the interactive HTML visualization. This URL should be provided to the user, as they will need to access it to view the interactive chart in their web browser.

Use this to get the current date and time in local timezone. Important: You MUST call this current_date_time function when: 1. User's query contains time-related words such as: - 今天、現在、目前 - 本週、這週、下週 - 本月、這個月、上個月 - 今年、去年、明年 - 最近、近期 - 未來、將來 - 過去、以前 2. User asks about current events or latest information 3. User wants to know time-sensitive information 4. Queries involving relative time expressions Examples of when to use current_date_time: - "今天的天氣如何？" - "本月的股市表現" - "最近有什麼新聞？" - "去年到現在的經濟成長" - "未來一週的活動預告" - "這個月的銷售數據" Returns: str: Current date and time in format "YYYY-MM-DD HH:MM Asia/Taipei"

Use this to generate high-quality images using DALL-E 3. Capabilities: - Creates photorealistic images and art - Handles complex scenes and compositions - Maintains consistent styles - Follows detailed prompts with high accuracy - Supports various artistic styles and mediums Best practices for prompts: - Be specific about style, mood, lighting, and composition - Include details about perspective and setting - Specify artistic medium if desired (e.g., "oil painting", "digital art") - Mention color schemes or specific colors - Describe the atmosphere or emotion you want to convey Limitations: - Cannot generate images of public figures or celebrities - Avoids harmful, violent, or adult content - May have inconsistencies with hands, faces, or text - Cannot generate exact copies of existing artworks or brands - Limited to single image generation per request Args: user_input: Detailed description of the image you want to generate. Be specific about style, content, and composition. Returns: str: URL to the generated image, or error message if generation fails

使用者會給你一個本地端的檔案路徑，請你使用這個 generate_tmp_public_url tool 生成一個臨時的公開 URL，這個 URL 可以讓使用者下載這個檔案。 如果使用者給了多個本地端的檔案路徑，請你多次呼叫這個 tool，並將每次呼叫的回傳值收集起來。 Args: file_path: The path to the local file you want to make publicly accessible Returns: str: A public URL that can be used to access the file for 7 days Raises: FileNotFoundError: If the specified file does not exist

Use this to scrape the web. as it provides better results for video content. Args: url: the url to scrape

Use this to search the web when you need up-to-date information or when your knowledge is insufficient. This tool uses Perplexity to perform web searches and provides detailed answers with citations. 除非使用者堅持要做多輪搜尋，不然這個工具能夠一次進行多個條件的搜尋，比如： 一次進行多條件範例1： - 可以： - web_search("搜尋今天的體育、財經、政治新聞", current_date_time) - 不需要： - web_search("搜尋今天的體育新聞", current_date_time) - web_search("搜尋今天的財經新聞", current_date_time) - web_search("搜尋今天的政台新聞", current_date_time) Time/Date Information Requirements: 1. MUST preserve any specific dates or time periods mentioned in the user's query 2. Include both the current time and any specific time references from the query Examples: - Basic query: User asks: "台灣的人口數量" web_search("台灣的人口數量", "2024-03-20 14:30 Asia/Taipei") Actual search: "台灣的人口數量" Returns: { "content": "根據最新統計，台灣人口約為2300萬...", "citations": [ {"title": "內政部統計處", "url": "https://www.moi.gov.tw/..."}, {"title": "國家發展委員會", "url": "https://www.ndc.gov.tw/..."} ] } - Query with specific date: User asks: "幫我查詢 2025/1/1 的新聞" web_search("幫我查詢 2025/1/1 的新聞", "2024-03-20 14:30 Asia/Taipei") Returns: { "content": "關於2025年1月1日的新聞預測...", "citations": [ {"title": "經濟日報", "url": "https://money.udn.com/..."}, {"title": "中央社", "url": "https://www.cna.com.tw/..."} ] } Args: user_input: The search query or question you want to find information about. MUST include any specific time periods or dates from the original query. Examples of time formats to preserve: - Specific dates: "2025/1/1", "2023-12-31" - Years: "2023年" - Quarters/Months: "第一季", "Q1", "一月" - Time periods: "過去三年", "未來五年" current_date_time: The current time string MUST be got by current_date_time() tool. You can NOT use the current time from your own knowledge. Format: "YYYY-MM-DD HH:MM Asia/Taipei" Returns: dict: A dictionary containing: - content (str): The detailed answer based on web search results - citations (list): A list of URLs, citation對使用者很重要，務必提供給使用者