Benchmark Factory - Beta Forum - Benchmark Factory Beta Program - Toad World

Benchmark Factory Beta Program Community

Benchmark Factory - Beta Forum

Kevin Dalton

The Beta for Benchmark Factory 8.0 has just been released!

Expand content
The beta version of Benchmark Factory 8.0 is now available to download! This is your opportunity to try out the new features and give product feedback before the official release!! New in this release...

The beta version of Benchmark Factory 8.0 is now available to download!  

This is your opportunity to try out the new features and give product feedback before the official release!!  New in this release, so far;

- Enhanced REST API.  The new REST API gives users even more control of jobs, tests, transactions, and test runs and results!  
- The REST API now accepts and returns not only XML, like it did in the last release, but now JSON!

Please try out this new beta and post comments/problems/suggestions to this forum.

2 0 / Create an account to join the discussion.
erdiaz
Follow / 10 Mar 2017 at 6:25pm / Benchmark Factory Beta Program
Latest post by on 13 Mar 2017 at 6:05pm

Installed BMF 7.6 Beta: Issues running TPC-C job

Expand content
I cannot get a TPC-C test to run against EDB 9.5 Postgres Plus Advanced Server using ODBC driver. It always gets stuck on the "Create Objects for TPC-C" test. In the database I created a user...

I cannot get a TPC-C test to run against  EDB 9.5 Postgres Plus Advanced Server using ODBC driver.  It always gets stuck on the "Create Objects for TPC-C" test.

In the database I created a user called pgtest that is a superuser and a db called pgtest that I drop & recreate between each attemped run.

Run 1

I create a TPC-C job with a Benchmark Scale of 1 (size 85.90 MB).  Under Test Options, neither Distribute index creation nor Distribute load using Benchmark Factory Agents are enabled.  I use the "Recreate objects and reload data every execution".   

Result:  The database objects are all created but the data is never loaded into the tables.  The job stays on the "Create Objects for TPC-C" test with a Status of "Loading Tables" and never finishes.

Messages:

TESTJOB2
Job Started
Starting Agent(s) on *******
Started test Create Objects for TPC-C
Delete Tables
Create Tables
Load Tables
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_properties" already exists;
Error while executing the query
...
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_load_progress" already exists;
Error while executing the query
Failed to create load progress table!
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_load_progress" already exists;
Error while executing the query

...

Stopping test - Create Objects for TPC-C
Exceeded virtual user communication timeout. Continuing to stop test.
Test cancelled due to errors.
Shutting down Agent(s) on *********
** Job finished.
Total Time to perform the job:
Start Time: 3/10/2017 12:36:55 PM
End Time : 3/10/2017 12:48:30 PM
Elapsed : 0 Days 00:11:35.339

Run 2

Same as previous run, except under Test Options, I enable Distribute load using Benchmark Factory Agents with 9 virtual users.

Result:  The database objects are all created and load begins and never ends.  The Status gets to Load Data 100% on each of the tables but the loading continues.  The job stays on the "Create Objects for TPC-C" step with a Status of "Loading Tables" and never finishes.  It does say 100% complete, but if I look at the row counts they just keep increasing and the 2nd step TPC-C Transaction Mix never becomes active.  

I then had to stop the job.

Messages:

TESTJOB2
Job Started
Starting Agent(s) on *****
Started test Create Objects for TPC-C
Delete Tables
Create Tables
Load Tables
Agent(*****) Error: ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_properties" already exists;
Error while executing the query
Stopping test - Create Objects for TPC-C
Test cancelled due to errors.
Shutting down Agent(s) on *****
** Job finished.
Total Time to perform the job:
Start Time: 3/10/2017 12:49:59 PM
End Time : 3/10/2017 1:02:01 PM
Elapsed : 0 Days 00:12:01.735

----------------------------------


If I just change the the database connection to be against an Oracle database it finishes successfully in about 7 minutes.

Thanks.

(By the way, I notice that no procedures are created in the EDB database - I guess this could be that the test just does straight ANSI SQL calls).

Answered 209 7 / Create an account to join the discussion.
Kevin Dalton
Follow / 7 Dec 2016 at 5:00pm / Benchmark Factory Beta Program
Latest post by on 5 Jan 2017 at 6:21pm

Benchmark Factory 7.6 Beta Now Available!!

Expand content
The beta version of Benchmark Factory 7.6 is now available to download! Give all the new features in this version a test drive and let us know what you think! - New SQL Native Driver support - This...

The beta version of Benchmark Factory 7.6 is now available to download!  

Give all the new features in this version a test drive and let us know what you think!

- New SQL Native Driver support - This new driver simplifies SQL Server testing and greatly speeds up the loading of the standard benchmarks for SQL Server!
- Bind Parameters now enabled for execution of prepared statements - This change in the way BMF handles bind parameters makes the entry or modification of a bind parameter value easier!
- Ability to specify the BMF Console port number

Please try out this new beta and post comments/problems/suggestions to this forum.

244 1 / Create an account to join the discussion.
Kevin Dalton
Follow / 5 Jul 2016 at 6:45pm / Benchmark Factory Beta Program
Latest post by on 2 Aug 2016 at 5:45pm

Try out Benchmark Factory 7.5 Beta!!!

Expand content
The initial release of Benchmark Factory 7.5 Beta is available now to try out!!! In this release we have made several enhancements to both Oracle and SQL Server Capture Process including; - Users...

The initial release of Benchmark Factory 7.5 Beta is available now to try out!!!

In this release we have made several enhancements to both Oracle and SQL Server Capture Process including;

- Users can specify CPU Usage, disk free space, and SYSTEM free space thresholds which, when exceeded, will automatically stop the capture.

- The Capture Status page has been redone to include much more information about the capture such as total sessions captured, unique users captured, etc.

- Both Capture wizards, both Oracle and SQL Server, have been changed to make more sense to the user.  

Try it out and let us know what you think!!

322 2 / Create an account to join the discussion.
Kevin Dalton
Follow / 22 Mar 2016 at 2:55pm / Benchmark Factory Beta Program
Latest post by on 18 May 2016 at 5:41pm

Benchmark Factory v7.4 Beta Now Available for Download!!!

Expand content
This beta of Benchmark Factory 7.4 has the ability to restart standard benchmark data loads after either failure or being cancelled by user. So no more having to restart those long data loads from the...

This beta of Benchmark Factory 7.4 has the ability to restart standard benchmark data loads after either failure or being cancelled by user.   So no more having to restart those long data loads from the very beginning!!!

Give it a try and tell us what you think.

501 2 / Create an account to join the discussion.
Kevin Dalton
Follow / 3 Mar 2014 at 5:23pm / Benchmark Factory Beta Program
Latest post by on 1 Apr 2014 at 4:47pm

Benchmark Factory v7.0 Beta is now available!!!

Expand content
Benchmark Factory v7.0 Beta is now available for download!! Click here to review the beta release notes to see the newest features with this release.

Benchmark Factory v7.0 Beta is now available for download!!  

 

Click here to review the beta release notes to see the newest features with this release. 

3852 2 / Create an account to join the discussion.
Daniel Norwood

The v7.0 beta will begin soon. Stay tuned!

Expand content
Join the group and subscribe to receive an activity digest to be notified automatically when the beta program begins.

Join the group and subscribe to receive an activity digest to be notified automatically when the beta program begins.

2867 0 / Create an account to join the discussion.