{"id":468,"date":"2019-07-17T14:31:37","date_gmt":"2019-07-17T14:31:37","guid":{"rendered":"http:\/\/www.hammerdb.com\/blog\/?p=468"},"modified":"2019-07-18T11:06:20","modified_gmt":"2019-07-18T11:06:20","slug":"how-to-add-your-database-to-hammerdb-pt3-adding-to-and-modifying-the-source","status":"publish","type":"post","link":"https:\/\/www.hammerdb.com\/blog\/uncategorized\/how-to-add-your-database-to-hammerdb-pt3-adding-to-and-modifying-the-source\/","title":{"rendered":"How to add your database to HammerDB – Pt3 Adding to and modifying the source"},"content":{"rendered":"\n

From the previous post we now have source and binary copies of HammerDB for modification and test. The next step is to see if there is an Issue already created for the database we want to add or whether we should create one. In this example using MariaDB there is already an Issue created Add MariaDB as a separate database <\/span> #54  <\/span><\/a>although note that this can be for any database you choose.  You now want to create a new branch for this work,  in this case using the Issue number for branch.<\/p>\n

git checkout -b 54
Switched to a new branch '54'
git branch
* 54
61
master<\/pre>\n
git status will also show you the current branch. You can now begin modifying the source to add your database.  Firstly in the database.xml in the config directory add the information for your new database.  Note in particular the prefix that will be used for variables and file and procedure names.  The commands section is used to identify words for highlighting in the script editor only. <\/p>\n
<mariadb>
<name>MariaDB<\/name>
<description>MariaDB<\/description>
<prefix>maria<\/prefix>
<library>mysqltcl<\/library>
<workloads>TPC-C TPC-H<\/workloads>
mysql::sel mysqluse mysqlescape mysqlsel mysqlnext mysqlseek mysqlmap mysqlexec mysqlclose mysqlinfo mysqlresult mysqlcol mysqlstate mysqlinsertid mysqlquery mysqlendquery mysqlbaseinfo mysqlping mysqlchangeuser mysqlreceive
mariadb><\/pre>\n
Then create an xml file with the name of the database, in this case mariadb.xml with values that will become the user defined variables in your workload.<\/p>\n
<?xml version=\"1.0\" encoding=\"utf-8\"?>
<mariadb>
<connection>
<maria_host>127.0.0.1<\/maria_host>
<maria_port>3306<\/maria_port>
<\/connection>
<tpcc>
<schema>
<maria_count_ware>1<\/maria_count_ware>
<maria_num_vu>1<\/maria_num_vu>
<maria_user>root<\/maria_user>
<maria_pass>mysql<\/maria_pass>
<maria_dbase>tpcc<\/maria_dbase>
<maria_storage_engine>innodb<\/maria_storage_engine>
<maria_partition>false<\/maria_partition>
<\/schema>
<driver>
...<\/pre>\n
As a test having created the config files and copied them to the binaries directory and run it we can see that MariaDB has been added as a database but cannot find the files that define the configuration and workloads, clearly this is  because we have not created them yet!<\/p>\n
\"\"<\/a><\/p>\n
If you run the CLI you will see the same message. However you can now set your database to MariaDB and print dict will show the variables you defined in the XML file.<\/p>\n
~\/HammerDB-Fork\/HammerDB-3.2$ .\/hammerdbcli 
HammerDB CLI v3.2
Copyright (C) 2003-2019 Steve Shaw
Type \"help\" for a list of commands
The xml is well-formed, applying configuration
Error loading database source files\/mariadb\/mariaopt.tcl
Error loading database source files\/mariadb\/mariaoltp.tcl
Error loading database source files\/mariadb\/mariaolap.tcl
Error loading database source files\/mariadb\/mariaotc.tcl
hammerdb>dbset db maria
Database set to MariaDB

hammerdb>print dict
Dictionary Settings for MariaDB
connection {
maria_host = 127.0.0.1
maria_port = 3306
}
tpcc {
maria_count_ware = 1
maria_num_vu = 1
maria_user = root
maria_pass = mysql
maria_dbase = tpcc
maria_storage_engine = innodb
maria_partition = false
maria_total_iterations = 1000000
maria_raiseerror = false
maria_keyandthink = false
maria_driver = test
maria_rampup = 2
maria_duration = 5
maria_allwarehouse = false
maria_timeprofile = false
}<\/pre>\n
 What you clearly  need to do next is to create the directory named after your database and the required files of mariadb\/mariaopt.tcl  for the graphical options screens, mariadb\/mariamet.tcl  for metrics, <\/span>mariadb\/mariaoltp.tcl for the scripts for the TPC-C  workloads, mariadb\/mariaolap.tcl for the TPC-H workloads and mariadb\/mariaotc.tcl for the online transaction counter.  You then need to modify these files according to your needs.  In this case as MariaDB is a fork of MySQL and the workloads are so close we are going to copy all of the required files from the MySQL directory, rename them and update the variable and procedure names from mysql to mariadb. <\/p>\n
A key feature is that the XML file where you defined the variables is stored as a dict structure with the prefix config and the name of your database. In this case configmariadb.  It is this dict which you use in the scripts to fetch and update the variables.<\/p>\n
\"\"<\/a>Starting with mariadb\/mariaopt.tcl we are setting the graphical options to interact with this dict.  In this case the options are the same for MariaDB as they are for MySQL however will be different for different databases. Copying the modified source to the binary directories enables testing.<\/p>\n
\"\"<\/a><\/p>\n
After modifying the graphical options we can then update and test the TPC-C schema build and tests in mariadb\/mariaoltp.tcl. As well as ensuring we are using configmariadb and updating the variable names we also need to change the procedure names to include the prefix defined in the XML file, in this case maria. Therefore the following procedures will exist for the schema build, test and timed test scripts respectively.<\/p>\n
proc<\/span> build_mariatpcc<\/span>
proc<\/span> loadmariatpcc<\/span> 
proc<\/span> loadtimedmariatpcc<\/span> <\/pre>\n
Once these changes have been made we can test the schema build.<\/p>\n
\"\"<\/a><\/p>\n
and timed test.<\/p>\n
\"\"<\/a><\/p>\n
and the transaction counter is updated in mariadb\/mariaotc.tcl<\/p>\n
\"\"<\/a><\/p>\n
Similarly we can update the TPC-H workload in mariadb\/mariaolap.tcl and then test the schema build.<\/p>\n
\"\"<\/a>and TPC-H query test<\/p>\n
\"\"<\/a><\/p>\n
At this point we have now created a new database under MariaDB but are running exactly the same schema builds and tests as the regular MySQL schemas. However this now gives us the opportunity to make the changes we want for MariaDB only such as adding PL\/SQL compatibility for the TPC-C workload or changes to support column stores for TPC-H. The important point is that  we have added support for a completely new database and all of the code changes do not impact any of the other databases in any way.<\/p>\n
Note that if you do not want your database to appear as an option in HammerDB it can be commented out in the database.xml file.<\/p>\n

<trafodion>
<name>Trafodion<\/name>
<description>Trafodion<\/description>
<prefix>traf<\/prefix>
tdbc::odbc
<workloads>TPC-C<\/workloads>
tdbc::odbc
<\/trafodion>
--><\/pre>\n\n\n","protected":false},"excerpt":{"rendered":"
From the previous post we now have source and binary copies of HammerDB for modification and test. The next step is to see if there is an Issue already created for the database we want to add or whether we should create one. In this example using MariaDB there is already an Issue created Add … <\/p>\n
Continue reading “How to add your database to HammerDB – Pt3 Adding to and modifying the source”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"ppma_author":[5],"class_list":["post-468","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"authors":[{"term_id":5,"user_id":2,"is_guest":0,"slug":"hammerdb","display_name":"HammerDB","avatar_url":{"url":"https:\/\/www.hammerdb.com\/blog\/wp-content\/uploads\/2018\/10\/logo-white.png","url2x":"https:\/\/www.hammerdb.com\/blog\/wp-content\/uploads\/2018\/10\/logo-white.png"},"author_category":"","user_url":"http:\/\/www.hammerdb.com","last_name":"","first_name":"","job_title":"","description":""}],"_links":{"self":[{"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/posts\/468","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/comments?post=468"}],"version-history":[{"count":14,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/posts\/468\/revisions"}],"predecessor-version":[{"id":528,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/posts\/468\/revisions\/528"}],"wp:attachment":[{"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/media?parent=468"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/categories?post=468"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/tags?post=468"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.hammerdb.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=468"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}