Test Data Pro AI FAQ
This topic provides a concise overview of significant questions and answers concerning the utilization of artificial intelligence (AI) in the Test Data Pro features.
What type of AI is being utilized?
BlazeMeter utilizes Microsoft Cognitive Services. The AI-driven features employ OpenAI's services. For more information, see
https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy
Does my Account have access to the AI features?
The AI features are exclusively available for Enterprise plans ("Unleashed"). Free, Basic, and Pro accounts do not have access to these features. If your account has access to the AI features and they are enabled, the first time you click the Create Data Automatically button, you will be presented with the following screen:
Will AI automatically access my data?
No, AI features for test data profiling are not activated by default. Your BlazeMeter account administrator needs to manually enable and approve the utilization of AI functionality for test data profiling. Furthermore, consent is mandatory from each user. In the absence of consent, AI features for test data profiling will remain inactive.
What is meant by AI features?
The BlazeMeter test data integration has the capability to provide more accurate data profiling as well as a wider range of generated data. Please note that OpenAI usage conditions are applicable, implying that test data generated by the AI service might include inaccuracies or unintended content beyond our control.
Will AI use my data to be trained for use cases outside of BlazeMeter? Will our data be shared with AI entities outside of BlazeMeter? Is Perforce utilizing any of my company’s private or sensitive data to train a large language model (LLM)?
No, BlazeMeter does not utilize any private or sensitive customer data to train the model used in our product.
We employ Microsoft Cognitive Services. Within BlazeMeter's paid service account, Microsoft does not utilize any data for machine learning purposes, and this data is not employed beyond the BlazeMeter environment.
Will other customers be able to generate data based on data other customers have used?
No, BlazeMeter does not utilize any private or sensitive customer data to train the model used in our product.
We employ Microsoft Cognitive Services. Within BlazeMeter's paid service account, Microsoft does not utilize any data for machine learning purposes, and this data is not employed beyond the BlazeMeter environment.
Do all BlazeMeter features now utilize AI?
No, AI is only integrated into specific components: the Data Profiler and Test Data Creator. Other functionalities remain unaffected. When you initiate the Data Creation Wizard for the first time, a dialog will notify you about the inclusion of AI features in the Data Profiler. You will have the option to opt in or out. Disabling the AI features will not impact the rest of the Data Creation Wizard.
Could the data generated by AI be too 'real'?
The generated test data is legitimate, yet fictional. Test data generators on the surface offer authentic-seeming data, such as real city names, ZIP codes, first names, last names, banks with RSSD IDs, and more. For instance, it can produce data that resembles actual credit card numbers or Social Security Numbers (SSNs) by employing publicly-known formulas. However, at a granular level, the generated test data is fabricated in the sense that it does not consist of personally identifiable information (PII). Random names, credit card numbers, addresses, phone numbers, SSNs, and the like are independently generated and are not linked to any specific individual. Any resemblance to real persons is purely coincidental.
What are the best practices concerning confidential test data?
Only submit anonymized data for profiling. For testing, utilize exclusively anonymized or synthetic data. Avoid employing production data or any content that comprises confidential or personally identifiable information (PII) as test data. This guideline extends to CSV files and sample data uploaded to the Data Profiler and Test Data Creator as well: Refrain from uploading files that include confidential data or PII.
How can I determine if AI features are enabled or disabled? Whom should I contact?
In your Personal Settings, under AI Consent, you can view your company's default AI Consent choice and submit your own preference. For inquiries concerning account-wide AI consent settings, please consult your organization's BlazeMeter Account administrator.
Does the Data Creation Wizard return different output when AI is enabled and when not?
If you cancel the AI enablement, the Data Profiler and Test Data Creator will still work, and only their built-in rules-based suggestions will be activated.
What happens if I choose to opt out later? Will tests that depend on the AI-driven Data Creator functions suddenly cease to function?
No, these tests will not stop working after opting out. AI functions tied to user consent are only utilized when generating test data and the results are cached. That's the extent of it. Additionally, there are other AI functions that don't require user data and therefore, they will consistently function with your tests.
How do I opt out of or opt in to these AI-driven features?
In the global Account Settings, your BlazeMeter Account administrators control the availability of AI features throughout your account. Your Account administrators determine whether users can individually opt in or opt out.
Unless your Account administrator enforces the account-wide setting, you can choose to opt in or opt out within your Personal Settings or decide to follow the account-wide setting.
Does BlazeMeter send a request for each data row? How long are the AI-generated values cached? How many data rows are cached? Can I utilize Data Parameters in functions like anySeedlist() and similarValues()?
We do not send a request for each individual data row. Rather, we retrieve 10 rows per each request. AI-generated values are not subject to caching. If necessary, we directly save these values into the test data model. Yes, you can indeed employ Data Parameters in functions such as anySeedlist() and similarValues().
Do these features require additional setup, training, or configuration?
No, the user interface will guide you. Training is available but not required.
Does the utilization of these features result in higher resource demands on my account, such as credits, engines, or private locations?
No, utilizing AI features doesn't incur any additional resource consumption. They also do not affect resource consumption on the private location side.
Are there any additional costs for using these features?
There are no additional fees or "token" usage associated with utilizing the AI features. The AI features are exclusively available for Enterprise plans ("Unleashed"). Free, Basic, and Pro accounts do not have access to these features.
Can we customize or fine-tune the ML (Machine Learning) models for our specific needs?
No, the models are pretrained.
What are the limits (number of rows)? How long does it take to generate large amounts of AI-driven test data?
There is no limit to the number of rows. There is only a time limit of 5 minutes. You can generate as large amount as can be transmitted to AI in 5 minutes.
What if the AI server is unavailable? Will a test with AI-driven test data fail?
In the event of AI unavailability or an AI error, we handle it in a standard manner and provide an appropriate error message to the user.
What type of uploaded data does Perforce store?
We store all data in a test data model within your workspace, which you have full control over: CSV files are stored as individual files, and function parameters are stored as test parameters.