WEBVTT

NOTE Tool use in AI

1
00:00:03.000 --> 00:00:08.960
This separate segment is about tool use in artificial intelligence, or A I.

2
00:00:08.960 --> 00:00:11.260
Many of you already use web chat.

3
00:00:11.980 --> 00:00:15.830
Tools extend what an A I system can do beyond producing a reply.

4
00:00:16.620 --> 00:00:21.500
We will look at working across files, running software, and editing inside

5
00:00:21.500 --> 00:00:22.180
applications.

6
00:00:23.280 --> 00:00:27.920
Desktop access can connect those tools to files and programs on your computer.

7
00:00:29.194 --> 00:00:34.234
A tool is a capability A I can call to get information or carry out an

8
00:00:34.234 --> 00:00:34.574
operation.

9
00:00:35.454 --> 00:00:39.154
When it searches the web, it calls a search tool and uses the returned

10
00:00:39.154 --> 00:00:39.594
results.

11
00:00:40.514 --> 00:00:44.534
When it analyzes an uploaded spreadsheet, it may run calculations through

12
00:00:44.534 --> 00:00:44.894
code.

13
00:00:45.914 --> 00:00:48.054
Image creation can also use a separate tool.

14
00:00:48.854 --> 00:00:53.194
To see your options, open the plus or tools menu beside your message box.

15
00:00:54.254 --> 00:00:58.014
Settings may also list tools, capabilities, apps, or connectors.

16
00:00:59.214 --> 00:01:01.754
Names and availability depend on your product and account.

17
00:01:02.614 --> 00:01:05.294
Some tools run automatically when the task calls for them.

18
00:01:06.503 --> 00:01:10.443
The diagram connects A I to four families of operations.

19
00:01:11.163 --> 00:01:14.743
A tool can find and read information from web pages,

20
00:01:15.683 --> 00:01:16.743
files, or connected sources.

21
00:01:17.483 --> 00:01:19.383
It can create and edit documents,

22
00:01:20.183 --> 00:01:21.323
images, or existing files.

23
00:01:21.963 --> 00:01:26.963
It can run software for calculations, data processing, or batches of repeated

24
00:01:26.963 --> 00:01:27.283
work.

25
00:01:27.783 --> 00:01:31.773
It can use applications through supported controls and actions.

26
00:01:32.323 --> 00:01:35.783
Check the operations a particular tool actually offers.

27
00:01:36.883 --> 00:01:40.903
Access to read a workbook does not by itself mean the tool can edit the

28
00:01:40.903 --> 00:01:41.243
workbook.

29
00:01:42.083 --> 00:01:45.203
The tool's capabilities set the boundaries of the task.

30
00:01:46.491 --> 00:01:50.231
Imagine your group has meeting notes and several progress updates.

31
00:01:51.091 --> 00:01:56.071
You want one status page showing completed work, open work, and conflicting

32
00:01:56.071 --> 00:01:56.591
decisions.

33
00:01:56.991 --> 00:02:01.361
The request on screen also asks for a source link beside each item.

34
00:02:02.051 --> 00:02:06.571
In web chat, upload the updates, then download the combined status document.

35
00:02:06.971 --> 00:02:12.491
With suitable desktop file tools, A I can read the existing project folder and

36
00:02:12.491 --> 00:02:13.311
save the page there.

37
00:02:13.971 --> 00:02:16.991
Those tools can connect the status to the original files.

38
00:02:17.831 --> 00:02:19.841
Either route can help combine the updates.

39
00:02:20.631 --> 00:02:25.091
Desktop access changes which files the tools can reach and where they save the

40
00:02:25.091 --> 00:02:25.241
result.

41
00:02:26.368 --> 00:02:29.288
Now consider a club's photos for social media.

42
00:02:30.188 --> 00:02:36.888
The request specifies square images, 1,080 by 1,080 pixels, with original

43
00:02:36.888 --> 00:02:38.048
proportions preserved.

44
00:02:39.108 --> 00:02:42.858
Padding fills the remaining space, so the program does not crop the photos.

45
00:02:43.468 --> 00:02:47.528
It saves copies in a separate folder and leaves the originals unchanged.

46
00:02:47.888 --> 00:02:53.768
In web chat, you can upload photos, ask A I to use Python, and download the

47
00:02:53.768 --> 00:02:55.348
resized copies as a zip file.

48
00:02:56.108 --> 00:03:00.968
Desktop execution can read an existing local folder and save copies there.

49
00:03:01.548 --> 00:03:05.928
A program repeats the same operation across the batch; you specify the

50
00:03:05.928 --> 00:03:08.048
dimensions and how to handle the originals.

51
00:03:09.362 --> 00:03:12.802
Suppose the club already tracks spending in a budget workbook.

52
00:03:13.742 --> 00:03:18.022
Ask for totals by expense category and a chart of planned and actual spending.

53
00:03:19.042 --> 00:03:23.222
Specify formulas linked to existing rows and preserve the transaction entries.

54
00:03:23.222 --> 00:03:27.442
Web chat can work on an uploaded copy that you download afterward.

55
00:03:28.282 --> 00:03:32.382
An application's own A I tools may edit directly inside the workbook,

56
00:03:32.762 --> 00:03:34.002
including a browser spreadsheet.

57
00:03:34.402 --> 00:03:38.382
A supported desktop connection may reach the existing local workbook.

58
00:03:39.122 --> 00:03:42.722
Choose the route that reaches your file and supports the editing operations

59
00:03:42.722 --> 00:03:43.462
you need.

60
00:03:44.202 --> 00:03:47.882
Afterward, inspect the formulas and confirm that transaction data stayed

61
00:03:47.882 --> 00:03:48.302
intact.

62
00:03:49.565 --> 00:03:51.805
A tool performs an operation.

63
00:03:52.525 --> 00:03:57.265
An agent chooses tools and uses their results to decide what to do next.

64
00:03:57.665 --> 00:04:01.465
The diagram shows a request leading to tool selection,

65
00:04:02.605 --> 00:04:05.075
execution, inspection of the result, and delivery.

66
00:04:05.825 --> 00:04:10.445
The photo request may first require listing files and checking available

67
00:04:10.445 --> 00:04:11.385
processing software.

68
00:04:12.365 --> 00:04:14.645
Those results help determine a resizing method.

69
00:04:15.345 --> 00:04:19.055
A later call runs the batch, and another can inspect the output.

70
00:04:19.885 --> 00:04:23.035
You specify the desired result and its boundaries.

71
00:04:23.505 --> 00:04:27.605
The enabled tools determine which steps the system can actually carry out.

72
00:04:28.265 --> 00:04:31.825
One user request can therefore involve several different operations.

73
00:04:33.162 --> 00:04:36.682
Start by identifying the operations your request needs.

74
00:04:37.462 --> 00:04:42.502
Your current web A I may already offer file creation or code execution through

75
00:04:42.502 --> 00:04:43.322
its tools menu.

76
00:04:44.202 --> 00:04:47.282
For online sources, look for apps or connectors.

77
00:04:48.182 --> 00:04:52.562
For local files, enable a suitable file tool and choose a permitted folder.

78
00:04:53.402 --> 00:04:57.142
For installed software, use a mode that supports local execution.

79
00:04:57.642 --> 00:05:02.882
To edit inside an application, open its A I panel or connect an editing tool.

80
00:05:03.802 --> 00:05:07.842
In Excel, check whether your account has the relevant Copilot editing access.

81
00:05:08.882 --> 00:05:13.082
Menu labels and availability can vary, so inspect the current product rather

82
00:05:13.082 --> 00:05:15.462
than assuming every route offers the same tools.

83
00:05:16.747 --> 00:05:20.967
Choose both what a tool can reach and what actions it may take.

84
00:05:21.927 --> 00:05:26.467
Limit file access to the task folder or workbook, and use copies while

85
00:05:26.467 --> 00:05:27.007
experimenting.

86
00:05:28.147 --> 00:05:32.107
Keep unrelated personal and work folders outside that permitted location.

87
00:05:32.687 --> 00:05:36.747
When approval is requested, read the action and destination.

88
00:05:38.127 --> 00:05:42.047
Renaming a file, overwriting it, and sending it elsewhere have different

89
00:05:42.047 --> 00:05:42.627
consequences.

90
00:05:43.527 --> 00:05:48.487
Extensions are software, so use official downloads and check the publisher.

91
00:05:49.027 --> 00:05:53.847
A document may contain instructions intended to redirect A I, known as prompt

92
00:05:53.847 --> 00:05:54.307
injection.

93
00:05:55.367 --> 00:05:59.067
Stop unexpected requests to send files elsewhere or install software.

94
00:06:00.067 --> 00:06:03.747
Access to a file is not permission to follow every instruction inside it.

95
00:06:04.868 --> 00:06:08.508
Local file access does not guarantee local processing.

96
00:06:09.348 --> 00:06:13.068
A file can stay on your computer while its contents are sent to an A I

97
00:06:13.068 --> 00:06:13.448
provider.

98
00:06:14.508 --> 00:06:18.848
Uploaded files go to the provider, and desktop tools may also send local

99
00:06:18.848 --> 00:06:20.158
content for processing.

100
00:06:21.188 --> 00:06:23.668
Review the account's storage and model-training settings.

101
00:06:24.908 --> 00:06:27.828
University and employer accounts can have different rules from personal

102
00:06:27.828 --> 00:06:28.228
accounts.

103
00:06:29.268 --> 00:06:33.808
Finally, distinguish stopping future access from deleting saved data.

104
00:06:34.588 --> 00:06:38.988
Removing folder permissions or disconnecting an app stops access through that

105
00:06:38.988 --> 00:06:39.348
connection.

106
00:06:40.308 --> 00:06:43.808
Use the provider's deletion controls for saved copies already sent.

107
00:06:44.688 --> 00:06:46.748
Check both parts when handling private material.

108
00:06:48.106 --> 00:06:50.946
Tools change what you can ask A I to do.

109
00:06:51.666 --> 00:06:56.106
They can help it read across files, run software, and work inside

110
00:06:56.106 --> 00:06:56.827
applications.

111
00:06:57.766 --> 00:06:59.926
Web tools may already support the task.

112
00:07:01.067 --> 00:07:05.606
Desktop access connects suitable tools to files and programs on your computer.

113
00:07:06.746 --> 00:07:07.826
Start with a concrete result,

114
00:07:08.826 --> 00:07:13.186
choose tools that can perform the needed operations, and set boundaries for

115
00:07:13.186 --> 00:07:14.346
access and changes.

116
00:07:14.346 --> 00:07:17.986
Then inspect the finished work before relying on it.
