Kevin Dalton

The Beta for Benchmark Factory 8.0 has just been released!

Expand content
The beta version of Benchmark Factory 8.0 is now available to download! This is your opportunity to try out the new features and give product feedback before the official release!! New in this release...

The beta version of Benchmark Factory 8.0 is now available to download!  

This is your opportunity to try out the new features and give product feedback before the official release!!  New in this release, so far;

- Enhanced REST API.  The new REST API gives users even more control of jobs, tests, transactions, and test runs and results!  
- The REST API now accepts and returns not only XML, like it did in the last release, but now JSON!

Please try out this new beta and post comments/problems/suggestions to this forum.

197 0 / Create an account to join the discussion.
erdiaz
Follow / 7 Mar 2017 at 3:05pm / Benchmark Factory
Latest post by on 7 Apr 2017 at 5:17pm

Run Benchmark Factory TPC-C job against Postgresql or EDB Postgres...

Expand content
I've been trying to run Benchmark Factory against both the Open Source PostgreSQL and the EDB Postgres Advanced Server via ODBC. On both I get the following error when creating objects for TPC-C: ...

I've been trying to run Benchmark Factory against both the Open Source PostgreSQL and the EDB Postgres Advanced Server via ODBC.  On both I get the following error when creating objects for TPC-C:  

Started test Create Objects for TPC-C

Delete Tables

Create Tables

Load Tables

ODBC Error (42P07,7) - ERROR: relation "tpc_c_properties" already exists;

Error while executing the query

Any ideas on how to get past this?  The tables appear to have all been created.

Ed

Unanswered 694 3 / Create an account to join the discussion.
erdiaz
Follow / 10 Mar 2017 at 6:25pm / Benchmark Factory Beta Program
Latest post by on 13 Mar 2017 at 6:05pm

Installed BMF 7.6 Beta: Issues running TPC-C job

Expand content
I cannot get a TPC-C test to run against EDB 9.5 Postgres Plus Advanced Server using ODBC driver. It always gets stuck on the "Create Objects for TPC-C" test. In the database I created a user...

I cannot get a TPC-C test to run against  EDB 9.5 Postgres Plus Advanced Server using ODBC driver.  It always gets stuck on the "Create Objects for TPC-C" test.

In the database I created a user called pgtest that is a superuser and a db called pgtest that I drop & recreate between each attemped run.

Run 1

I create a TPC-C job with a Benchmark Scale of 1 (size 85.90 MB).  Under Test Options, neither Distribute index creation nor Distribute load using Benchmark Factory Agents are enabled.  I use the "Recreate objects and reload data every execution".   

Result:  The database objects are all created but the data is never loaded into the tables.  The job stays on the "Create Objects for TPC-C" test with a Status of "Loading Tables" and never finishes.

Messages:

TESTJOB2
Job Started
Starting Agent(s) on *******
Started test Create Objects for TPC-C
Delete Tables
Create Tables
Load Tables
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_properties" already exists;
Error while executing the query
...
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_load_progress" already exists;
Error while executing the query
Failed to create load progress table!
ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_load_progress" already exists;
Error while executing the query

...

Stopping test - Create Objects for TPC-C
Exceeded virtual user communication timeout. Continuing to stop test.
Test cancelled due to errors.
Shutting down Agent(s) on *********
** Job finished.
Total Time to perform the job:
Start Time: 3/10/2017 12:36:55 PM
End Time : 3/10/2017 12:48:30 PM
Elapsed : 0 Days 00:11:35.339

Run 2

Same as previous run, except under Test Options, I enable Distribute load using Benchmark Factory Agents with 9 virtual users.

Result:  The database objects are all created and load begins and never ends.  The Status gets to Load Data 100% on each of the tables but the loading continues.  The job stays on the "Create Objects for TPC-C" step with a Status of "Loading Tables" and never finishes.  It does say 100% complete, but if I look at the row counts they just keep increasing and the 2nd step TPC-C Transaction Mix never becomes active.  

I then had to stop the job.

Messages:

TESTJOB2
Job Started
Starting Agent(s) on *****
Started test Create Objects for TPC-C
Delete Tables
Create Tables
Load Tables
Agent(*****) Error: ODBC Error (42P07,7, 1) - ERROR: relation "tpc_c_properties" already exists;
Error while executing the query
Stopping test - Create Objects for TPC-C
Test cancelled due to errors.
Shutting down Agent(s) on *****
** Job finished.
Total Time to perform the job:
Start Time: 3/10/2017 12:49:59 PM
End Time : 3/10/2017 1:02:01 PM
Elapsed : 0 Days 00:12:01.735

----------------------------------


If I just change the the database connection to be against an Oracle database it finishes successfully in about 7 minutes.

Thanks.

(By the way, I notice that no procedures are created in the EDB database - I guess this could be that the test just does straight ANSI SQL calls).

Answered 501 7 / Create an account to join the discussion.
sglixman
Follow / 13 Feb 2017 at 12:13pm / Benchmark Factory
Latest post by on 17 Feb 2017 at 6:07am

DellBF fail immediately: Error obtaining max(t_id) from E_TRADE

Expand content
Hello, I am trying to start DellBF, but fail immediately: Error obtaining max(t_id) from E_TRADE Manually running: SELECT max (T_ID) FROM [Test-BF].[dbo].[E_TRADE]; Works great Any idea what...

Hello,

I am trying to start DellBF, but fail immediately: Error obtaining max(t_id) from E_TRADE

Manually running:

SELECT max (T_ID)
FROM [Test-BF].[dbo].[E_TRADE];

Works great

Any idea what can be the problem?

DB: MsSql

Complete Dell-BF message is:

TPC-E Job
Job Started
Started test TPC-E Transaction Mix
Checking scale factor...
The loaded scale factor(0) doesn't match the specified scale factor (1) for the TPC-E benchmark.
Scale factor check complete.
Agent(WIN-47G9THU8OBD) Error: Error obtaining max(t_id) from E_TRADE. Transaction "TradeUpdate Transaction" run failed by virtual user 38 in agent 2 of WIN-47G9THU8OBD

759 3 / Create an account to join the discussion.
Kevin Dalton
Follow / 7 Dec 2016 at 5:00pm / Benchmark Factory Beta Program
Latest post by on 5 Jan 2017 at 6:21pm

Benchmark Factory 7.6 Beta Now Available!!

Expand content
The beta version of Benchmark Factory 7.6 is now available to download! Give all the new features in this version a test drive and let us know what you think! - New SQL Native Driver support - This...

The beta version of Benchmark Factory 7.6 is now available to download!  

Give all the new features in this version a test drive and let us know what you think!

- New SQL Native Driver support - This new driver simplifies SQL Server testing and greatly speeds up the loading of the standard benchmarks for SQL Server!
- Bind Parameters now enabled for execution of prepared statements - This change in the way BMF handles bind parameters makes the entry or modification of a bind parameter value easier!
- Ability to specify the BMF Console port number

Please try out this new beta and post comments/problems/suggestions to this forum.

443 1 / Create an account to join the discussion.