FAQs

Can we use C#, JS, PHP, Python, etc. for our scripting rather than JAVA?

  • Yes, but we don’t recommend it. In our experience JAVA has the most comprehensive open source interface libraries including , iOS, Android, security, IDE, Performance, File Systems, Databases, APIs, CLI, Operating Systems etc.  Also, because we have already pre-scripted the common steps, you only need to do coding when creating new or custom steps, so it is still vastly cheaper and faster to leverage our existing JAVA based automation scripts, irrespective of your default stack.

Can we use our existing CI/CD server or a different one such as Bamboo, BitBucket Pipelines, Azure Pipelines etc?

  • Yes, Nimbal Tree can execute against most common CI/CD servers, but Jenkins is still the most comprehensive and cost effective in our opinion.

Can we run Nimbal Auto run on premise rather than in the Cloud?

  • Yes, hardware sizing will depend on the peak workload i.e. the number of tests to be executed in a given timeframe.  The need for variable and scalable resource makes Cloud more attractive though.

Can we run the Nimbal Tree test management portal on premise?

  • Yes, but it is not recommended.  Nimbal Tree is set up in a private Google Cloud Platform (GCP) for each customer either on a new GCP or their existing GCP.  

Can we reuse our existing automated tests?

  • Yes, Nimbal Tree can manage existing test automations alongside Nimbal Auto and will execute the test against the relevant platform.  

Which programming language is supported for extending framework capabilities?

  • Java

What additional benefit Nimbal provides as compared other popular framework?

  • We have built a wrapper over open-source technologies (Appium,jmeter,intellij,jenkins etc.) to build a comprehensive tool that allows you to run almost all types of tests. We give you this framework out-of-the-box hence, no set-up time or consultancy skills required.
  • All the tests are written in simple Gherkin language with drop down options available, so building and writing tests becomes fast and easy. As little as a tenth of the time as coding a test and integrating it
  • The optional Web-based IDE allows you to quickly provision a test environment and makes it easy to maintain and for your team to collaborate on it from anywhere.
  • We provide you with a Management Portal that gives your management full visibility or test results, test coverage and better integrate testing into your change management process
  • The Management Portal also allows you to tag your tests to help with scheduling, view live execution of tests, provides step level error reporting with screen shots and sends alerts via email, slack etc.
  • Phone app tests can be pushed to AWS device farm to supplement emulator tests with real world device testing

Is there something which we cannot test or automate with Nimbal?

  • We have not found anything yet. If there is a particular use case/feature that you wish to add, let us know and we can work on it and make it available. We welcome new ideas and opportunities. 
    NOTE: we do not do unit testing.

How to get support if automation developer is stuck in something?

  • In our client onboarding process, we invest time to train you and answer your questions for 2-3 weeks at no charge. This would help answer most of the questions your team may have but we also provide priority based support via Zendesk (included in your License).

What type of framework it is - Keyword / BDD / Module / Hybrid ?

  • BDD

list of supported libraries ? Only proprietary or opens source libraries also available?

  • We mostly integrate open source libraries and resources such as Rest Assured, JMeter, Winium, Appium, Selenium, Zap Proxi, etc, but also support chargeable functions such as DataMasque for GDPR compliance.

Is there support for MAC, Linux, Android and iOS ?

  • Yes, note you will need to run iOS testing on a MAC of some kind

Does Nimbal provide test case documentation facility ?

  • Yes, with Nimbal Tree you can generate reports, have access to visual analytics and get step level error reports.
  • You can view live run of tests, view recordings, screenshots and get alerts via email, slack etc.

Trial period or license for POC?

  • We recommend a no obligation PoC with you, where we work closely with at lease one member of your team. We train them and answer their questions at no charge. This allows both parties to understand the relationship dynamic and can take the next step confidently.

How will a user receive future updates once installed?

  • For a Web IDE, we update on an agreed schedule as part of the service
  • For a Physical IDE we provide a JAR file

How does it handle end to end flow ? Like the configuration through the UI, traffic initiated by different applications (SSH/RDP) and the backend verification if any on the AWS CloudWatch or DocumentDB etc.,

  • The automation allows long and complex, multi platform automation steps for production and testing purposes. The best thing would be to show you during the trial period.  Get in touch

Does it provide any performance testing capabilities?

  • Yes – Jmeter and its reports are fully integrated

Are there any recording facilities?

  • Yes, with Nimbal Tree you can view video, screens shots at each steps, or just on error, step level visual and text report, analytics, coverage etc

Can we perform parallel testing?

Yes, At Nimbal we perform parallel test at scale by integrating test automation frameworks with a cloud-based solution, which takes care of device management. The opposite of parallel testing is sequential testing. This entails executing one test after another. This is a much more time-consuming approach to testing.

 

What Web browsers are supported?

We support the following browsers at Nimbal:

  • Google Chrome (latest version) — Windows, Mac OS X, iOS, Android.
  • Apple Safari (latest version) — Mac OS X, iOS.
  • Microsoft Internet Explorer 11+ — Windows.
  • Microsoft Edge (latest version) — Windows.
  • Mozilla Firefox (latest version) — Windows.

Can we do mobile browser tests?

At Nimbal all the testing is automated and is done using the virtual devices which provides us the facility to access numerous versions of devices at a time. We perform testing on highly reliable applications like Emulator for Android mobile testing which is compatible with Chrome and Simulator for iOS mobile testing which is well suited for Safari. One can view or test the mobile version of websites using the DevTools for mobile emulation

Can we perform tests on multiple mobile device OS versions?

Yes, we can perform tests on multiple mobile device OS versions using the Android and iOS configurations.

For more details Click here

Can we test on physical mobile devices?

Yes, we can test on physical Mobile devices. Testing mobile Web sites using browsers, and testing using emulators along with Appium interface. Using this combination, along with a solid test plan, should bring you to a point where your mobile site is stable and appears to be working correctly on a number of devices. An emulator is a simulation of how the device should behave, i.e., if any part of the simulation is incorrect, even in a minute way, then the emulator’s behaviour may differ from the real device. The only way to prove your site or application works correctly on a range of devices is to physically test it on real devices.

How do we create data verification tests ?

Nimbal has a library that allows you to store, save, compare and verify data can create data verification points to test the data in your application. When you record the verification point, a baseline of the data is created.

Every time you playback the script, the data is compared to check if any changes have occurred.

This helps in identifying any mismatch in data.

Can we use an excel/csv file to input data that will be used in the test?

Yes, we can use an excel/ CSV file to input data. In any case, CSV files have no types. Excel can only import it and try to guess whether the text values correspond to a certain type, using the user’s locale settings.

How do we handle browser pop-ups?

Yes, at Nimbal we use four methods for the effective Web-based pop-up handling:

  • string getText() method returns the text displayed on the alert box
  • void accept() method clicks on the “Ok” button as soon as the pop-up window appears
  • void dismiss() method clicks on the “Cancel” button as soon as the pop-up window appears
  • void sendKeys(String stringToSend) method enters the specified string pattern into the alert box

Can we grab and store data during the tests?

Yes, we render the facility to grab and store data during the tests with the support of our Nimbal Framework and Libraries. A file system that’s similar to disk-based file systems on other platforms. The system provides several options for you to save your app data:

  • App-specific storage: Store files that are meant for your app’s use only, either in dedicated directories within an internal storage volume or different dedicated directories within external storage. Use the directories within internal storage to save sensitive information that other apps shouldn’t access.
  • Shared storage: Store files that your app intends to share with other apps, including media, documents, and other files.
  • Preferences: Store private, primitive data in key-value pairs.
  • Databases: Store structured data in a private database using the Room persistence library.

Can we automate captcha?

We cannot automate CAPTCHA, as it is not meant to be automatized. How to deal with CAPTCHA? Either ask the dev team for a workaround, like configure CAPTCHA in a test environment in such a way it will always accept 1 specific value. Ask a developer to disable the CAPTCHA module in the testing environment.

How do we handle loading pages?

We have Nimbal frameworks and utilities to build steps that will help page handling and loading.

Do you support API testing?

Yes. We do support API testing. The aim is to determine whether the APIs that are developed meet expectations when it comes to functionality, performance, reliability and security for an application.

For more Information Click Here

Can you run CLI commands?

We have pre-built steps in our Nimbal library for executing the CLI commands

Can you use data from SQL Databases?

We are able to use data from SQL Databases as Nimbal frameworks and utilities have pre- built libraries for the users.

Can we use JSON files?

We access the JSON files using the Nimbal frameworks.

For more Information Click here

How do we perform upload and download steps in testing?

We will have access to Nimbal frameworks for uploading and downloading steps in testing.

How do we identify element locators?

We access to the JSON files using the Nimbal frameworks.

For more Information Click here

Can we utilize dynamic data for data input?

We have access to the JSON files using the Nimbal frameworks.

Can we do security testing?

Yes, We can do Security testing. Security testing will help to reveal flaws in the security mechanisms of an information system that protect data and maintain functionality as intended.

Typical security requirements may include specific elements of confidentiality, integrity, authentication, availability, authorization and non-repudiation. Actual security requirements tested depend on the security requirements implemented by the system

For more Information Click here

Can we do performance testing?

Yes, we can do performance testing and this can be done as soon as several web pages are working, the first load tests should be conducted by the quality assurance team. From that point forward, performance testing should be part of the regular testing routine each day for each build of the software. That will determine the stability, speed, scalability, and responsiveness of an application holds up under a given workload.

For more Information Click here