SQL LIKE operation in Cassandra, is possible in v3.4+

August 12, 2016Uncategorizedtobias

For a long time it has not been possible to do a SELECT * FROM table WHERE firstname like ‘t%’; in Cassandra like you could in eg.. MySQL or any other Relation Database for that matter.

In Cassandra v3.4 this is now possible, BUT it requires some extra to do it right, and that is why I created this blog post cause I had trouble finding it.

The solution is to create a separate index, and not the secondary indexes that Cassandra came with, but a different index, called a SASI index.

This is what I have

CREATE TABLE bth.employee (
    id int,
    lastname text,
    firstname text,
    dateofbirth date,
    PRIMARY KEY (id, lastname, firstname)
) WITH CLUSTERING ORDER BY (lastname ASC, firstname ASC)
    AND bloom_filter_fp_chance = 0.01
    AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
    AND comment = ''
    AND compaction = {'bucket_high': '1.5', 'bucket_low': '0.5', 'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'enabled': 'true', 'max_threshold': '32', 'min_sstable_size': '50', 'min_threshold': '4', 'tombstone_compaction_interval': '86400', 'tombstone_threshold': '0.2', 'unchecked_tombstone_compaction': 'false'}
    AND compression = {'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
    AND crc_check_chance = 1.0
    AND dclocal_read_repair_chance = 0.1
    AND default_time_to_live = 0
    AND gc_grace_seconds = 864000
    AND max_index_interval = 2048
    AND memtable_flush_period_in_ms = 0
    AND min_index_interval = 128
    AND read_repair_chance = 0.0
    AND speculative_retry = '99PERCENTILE';

CREATE TABLE bth.employee (

id int,

lastname text,

firstname text,

dateofbirth date,

PRIMARY KEY (id, lastname, firstname)

) WITH CLUSTERING ORDER BY (lastname ASC, firstname ASC)

AND bloom_filter_fp_chance = 0.01

AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}

AND comment = ''

AND compaction = {'bucket_high': '1.5', 'bucket_low': '0.5', 'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'enabled': 'true', 'max_threshold': '32', 'min_sstable_size': '50', 'min_threshold': '4', 'tombstone_compaction_interval': '86400', 'tombstone_threshold': '0.2', 'unchecked_tombstone_compaction': 'false'}

AND compression = {'chunk_length_in_kb': '64', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}

AND crc_check_chance = 1.0

AND dclocal_read_repair_chance = 0.1

AND default_time_to_live = 0

AND gc_grace_seconds = 864000

AND max_index_interval = 2048

AND memtable_flush_period_in_ms = 0

AND min_index_interval = 128

AND read_repair_chance = 0.0

AND speculative_retry = '99PERCENTILE';

And the content of it looks like this

cqlsh:bth> select * from bth.employee;

 id | lastname    | firstname | dateofbirth
----+-------------+-----------+-------------
  1 |    eriksson |    tobias |  1973-06-11
  2 |  holgersson |    marcus |  1972-08-01
  7 |    eriksson |     linda |  1974-06-11
  3 | abrahamsson |    ingvar |  1959-10-05

(4 rows)
cqlsh:bth>

cqlsh:bth> select * from bth.employee;

id | lastname | firstname | dateofbirth

----+-------------+-----------+-------------

1 | eriksson | tobias | 1973-06-11

2 | holgersson | marcus | 1972-08-01

7 | eriksson | linda | 1974-06-11

3 | abrahamsson | ingvar | 1959-10-05

(4 rows)

cqlsh:bth>

And now I would like to search for all the rows that has a first name that starts with a ‘t’

In SQL that would have been :

SELECTÂ * FROMÂ bth.employee WHEREÂ firstname LIKEÂ ‘t%’;

In fact we could have done that on any column …. but in Cassandra it would result in something like this:

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like 't%';
InvalidRequest: code=2200 [Invalid query] message="firstname LIKE '<term>%' restriction is only supported on properly indexed columns"
cqlsh:bth>

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like 't%';

InvalidRequest: code=2200 [Invalid query] message="firstname LIKE '<term>%' restriction is only supported on properly indexed columns"

cqlsh:bth>

In Cassandra we first has to decide on which columns this should be possible, by creating an index like this:

CREATE CUSTOM INDEX employee_firstname_idx ON bth.employee (firstname) USING 'org.apache.cassandra.index.sasi.SASIIndex' WITH OPTIONS = {'analyzer_class': 'org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer', 'case_sensitive': 'false'};

1	CREATE CUSTOM INDEX employee_firstname_idx ON bth.employee (firstname) USING 'org.apache.cassandra.index.sasi.SASIIndex' WITH OPTIONS = {'analyzer_class': 'org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer', 'case_sensitive': 'false'};

And so you can now do the following

cqlsh:bth>SELECT * FROM bth.employee WHERE firstname LIKE 't%';

 id | lastname | firstname | dateofbirth
----+----------+-----------+-------------
  1 | eriksson |    tobias |  1973-06-11

(1 rows)
cqlsh:bth>

cqlsh:bth>SELECT * FROM bth.employee WHERE firstname LIKE 't%';

id | lastname | firstname | dateofbirth

----+----------+-----------+-------------

1 | eriksson | tobias | 1973-06-11

(1 rows)

cqlsh:bth>

But what if you decide that I would like to know all the employees that ends with an ‘s’ in their name, so something like this:

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like '%s';
InvalidRequest: code=2200 [Invalid query] message="firstname LIKE '%<term>' restriction is only supported on properly indexed columns"
cqlsh:bth>

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like '%s';

InvalidRequest: code=2200 [Invalid query] message="firstname LIKE '%<term>' restriction is only supported on properly indexed columns"

cqlsh:bth>

So to be able to search for something that contains we have to change the index like this instead:

CREATE CUSTOM INDEX employee_firstname_idx ON bth.employee (firstname) USING 'org.apache.cassandra.index.sasi.SASIIndex' WITH OPTIONS = {'mode': 'CONTAINS', 'analyzer_class': 'org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer', 'case_sensitive': 'false'};

1	CREATE CUSTOM INDEX employee_firstname_idx ON bth.employee (firstname) USING 'org.apache.cassandra.index.sasi.SASIIndex' WITH OPTIONS = {'mode': 'CONTAINS', 'analyzer_class': 'org.apache.cassandra.index.sasi.analyzer.StandardAnalyzer', 'case_sensitive': 'false'};

And now you can run that query again:

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like '%s';

 id | lastname   | firstname | dateofbirth
----+------------+-----------+-------------
  1 |   eriksson |    tobias |  1973-06-11
  2 | holgersson |    marcus |  1972-08-01

(2 rows)
cqlsh:bth>

cqlsh:bth> SELECT * FROM bth.employee WHERE firstname like '%s';

id | lastname | firstname | dateofbirth

----+------------+-----------+-------------

1 | eriksson | tobias | 1973-06-11

2 | holgersson | marcus | 1972-08-01

(2 rows)

cqlsh:bth>

You can read more about the SASI index hereÂ https://docs.datastax.com/en/cql/3.3/cql/cql_reference/refCreateSASIIndex.html

Enjoy!

-Tobias

UDF/User Defined Functions in Cassandra 3.x

August 11, 2016Cassandra, JAVAtobias

I was just playing around with Cassandra WRITETIME and thought it was somewhat difficult to figure out the date / timestamp of a number like this (microseconds since EPOC) 1470645914253000.

So in my example it looked like this

cqlsh:bth> select id, writetime(dateofbirth) from bth.employee;

 id | writetime(dateofbirth)
----+------------------------
  1 |       1470645914253000
  2 |       1470645977177000
  7 |       1470948508799001
  3 |       1470645977178000

(4 rows)
cqlsh:bth>

cqlsh:bth> select id, writetime(dateofbirth) from bth.employee;

id | writetime(dateofbirth)

----+------------------------

1 | 1470645914253000

2 | 1470645977177000

7 | 1470948508799001

3 | 1470645977178000

(4 rows)

cqlsh:bth>

So I figured why not create a UDF that would solve this for me

That turned out to be a little bit of a challenge …

I thought that I could do like this

CREATE FUNCTION bth.ts2date ( input bigint )
	RETURNS NULL ON NULL INPUT
    RETURNS text 
    LANGUAGE java
    AS $$
    	if( input > 0L ) {
    		long ms = input / 1000L;
    		Date date=new Date(ms);
    		SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss,SSS");
    		return sdf.format(date);
    	} else return null;
    $$;

CREATE FUNCTION bth.ts2date ( input bigint )

RETURNS NULL ON NULL INPUT

RETURNS text

LANGUAGE java

AS $$

if( input > 0L ) {

long ms = input / 1000L;

Date date=new Date(ms);

SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss,SSS");

return sdf.format(date);

} else return null;

$$;

BUT NO, YOU CAN NOT!!!

There are several WRONGS in here it turns out

First off you have to turn on
enable_user_defined_functions: true
in the conf/cassandra.yaml file
All classes has to be fully qualified, so Date would be java.util.Date, and so on…
The division operator ‘/’ can not be used !!! however +,- and * works fine. surely this must be a bug … this called for some thinking…

The error I got when trying to use the code above without fully qualified names was

cqlsh> CREATE FUNCTION ts2date ( input bigint )
   ... RETURNS NULL ON NULL INPUT
   ...     RETURNS text 
   ...     LANGUAGE java
   ...     AS $$
   ...     if( input != null ) {
   ...     Date date=new Date(mills);
InvalidRequest: code=2200 [Invalid query] message="Functions must be fully qualified with a keyspace name if a keyspace is not set for the session"

cqlsh> CREATE FUNCTION ts2date ( input bigint )

... RETURNS NULL ON NULL INPUT

... RETURNS text

... LANGUAGE java

... AS $$

... if( input != null ) {

... Date date=new Date(mills);

InvalidRequest: code=2200 [Invalid query] message="Functions must be fully qualified with a keyspace name if a keyspace is not set for the session"

And the reason, if I got it right, is that you can not do imports.

The error I got when trying to use the division ‘/’ operator was this:

cqlsh:bth> CREATE FUNCTION bth.ts2date ( input bigint )
       ... RETURNS NULL ON NULL INPUT
       ...     RETURNS text 
       ...     LANGUAGE java
       ...     AS $$
       ...     if( input > 0L ) {
       ...     java.util.Date date=new java.util.Date(input/1000);
Invalid syntax at line 7, char 49
      java.util.Date date=new java.util.Date(input/1000);
                                                  ^
cqlsh:bth>

cqlsh:bth> CREATE FUNCTION bth.ts2date ( input bigint )

... RETURNS NULL ON NULL INPUT

... RETURNS text

... LANGUAGE java

... AS $$

... if( input > 0L ) {

... java.util.Date date=new java.util.Date(input/1000);

Invalid syntax at line 7, char 49

java.util.Date date=new java.util.Date(input/1000);

cqlsh:bth>

The code that works looks like this, using java.math.BigDecimal to solve it was perhaps a so-so solution, but it works:

CREATE FUNCTION bth.ts2date ( input bigint ) 
RETURNS NULL ON NULL INPUT     
RETURNS text      
LANGUAGE java     
AS $$     
	if( input > 0L ) {     
		java.math.BigDecimal t = java.math.BigDecimal.valueOf(1000L);     
		java.math.BigDecimal inp = java.math.BigDecimal.valueOf(input);     
		java.math.BigDecimal mst = inp.divide(t); 
		long ms = mst.longValue();     
		java.util.Date date=new java.util.Date(ms);     
		java.text.SimpleDateFormat sdf = new java.text.SimpleDateFormat("yyyy-MM-dd HH:mm:ss,SSS");     
		return sdf.format(date);     
	} else return null;     
$$;

CREATE FUNCTION bth.ts2date ( input bigint )

RETURNS NULL ON NULL INPUT

RETURNS text

LANGUAGE java

AS $$

if( input > 0L ) {

java.math.BigDecimal t = java.math.BigDecimal.valueOf(1000L);

java.math.BigDecimal inp = java.math.BigDecimal.valueOf(input);

java.math.BigDecimal mst = inp.divide(t);

long ms = mst.longValue();

java.util.Date date=new java.util.Date(ms);

java.text.SimpleDateFormat sdf = new java.text.SimpleDateFormat("yyyy-MM-dd HH:mm:ss,SSS");

return sdf.format(date);

} else return null;

$$;

So now my output in cqlsh.sh looks like this now

cqlsh:bth> select id, ts2date(writetime(dateofbirth)) from bth.employee;

 id | bth.ts2date(writetime(dateofbirth))
----+-------------------------------------
  1 |             2016-08-08 10:45:14,253
  2 |             2016-08-08 10:46:17,177
  7 |             2016-08-11 22:48:28,799
  3 |             2016-08-08 10:46:17,178

(4 rows)
cqlsh:bth>

cqlsh:bth> select id, ts2date(writetime(dateofbirth)) from bth.employee;

id | bth.ts2date(writetime(dateofbirth))

----+-------------------------------------

1 | 2016-08-08 10:45:14,253

2 | 2016-08-08 10:46:17,177

7 | 2016-08-11 22:48:28,799

3 | 2016-08-08 10:46:17,178

(4 rows)

cqlsh:bth>

That is a lot better !

Cassandra set the writetime explicitly with a PreparedStatement

March 16, 2016Cassandra, JAVA, Scalatobias

This is a quick one, I wanted to set the writetime of a row explicitly when I populate the database for testing purposes. We use the writetime of a column to filter them out.

It required some looking around to find out how to do this…. so I figured I write an article about it.

INSERT INTO invoices (invoice_id,amount,tax,description) VALUES ('333',10,3,'ice-cream') USING TIMESTAMP 1458134077121;

1	INSERT INTO invoices (invoice_id,amount,tax,description) VALUES ('333',10,3,'ice-cream') USING TIMESTAMP 1458134077121;

The timestamp will be set for ALL cells in this row (well not the primary key, cause it does not have a timestamp, but the others).

The timestamp is given as millisecondsÂ since EPOC, so lots of digitsÂ :-).

A prepared statement would then look like this (Scala code)

val cql = "INSERT INTO invoices (invoice_id,amount,tax,description) VALUES (?,?,?,?) USING TIMESTAMP ?;"

val stmt = session.prepare( cql )

val bs = stmt.bind()

bs.setString("invoice_id", "333" )

bs.setLong("amount", 10L )

bs.setLong("tax", 3L )

bs.setString("description","ice-cream")

bs.setLong("[timestamp]", 1458134077121L )

val result = Â session.execute( bs )

val cql = "INSERT INTO invoices (invoice_id,amount,tax,description) VALUES (?,?,?,?) USING TIMESTAMP ?;"

val stmt = session.prepare( cql )

val bs = stmt.bind()

bs.setString("invoice_id", "333" )

bs.setLong("amount", 10L )

bs.setLong("tax", 3L )

bs.setString("description","ice-cream")

bs.setLong("[timestamp]", 1458134077121L )

val result = Â session.execute( bs )

TTL and TIMESTAMP can both be set like this, i.e. with [ttl] and [timestamp]

-Tobias

Apache SPARK and Cassandra and SQL

January 21, 2016Uncategorizedapache, cassandra, cassandrasqlcontext, dependencies, exception, nosuchmethodexception, sbt, scala, spark, sqltobias

This is a short intro to start using Apache SPARK with Cassandra, running SQL on the Cassandra tables.

Note that I am not running a SPARK cluster, I am running “local”, to me this is really convenient, not having to run a SPARK server and workers for something so small. So for playing around with SPARK and Cassandra this is really good.

I am using Scala and SBT.

Something I was struggling hard with, to get the dependency versions right. It is crucial that you do not do like I did first, use version 1.5.2 of Spark and 1.5.0 for SparkCassandraConnector, this will NOT work. I constantly got exception withÂ java.lang.NoSuchMethodException, so incredibly frustrating to try out version after version.

Caused by: java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.LogicalRelation.<init>(Lorg/apache/spark/sql/sources/BaseRelation;)V

1	Caused by: java.lang.NoSuchMethodError: org.apache.spark.sql.execution.datasources.LogicalRelation.<init>(Lorg/apache/spark/sql/sources/BaseRelation;)V

build.sbt

val sparkV = "1.5.0"
val sparkCassandraConnectorV = "1.5.0-RC1"
val cassandraDriverV = "3.0.0-rc1"

libraryDependencies += "joda-time"           %   "joda-time"         % "2.9.1"
libraryDependencies += "org.slf4j"           %   "slf4j-api"         % "1.7.10"
libraryDependencies += "ch.qos.logback"      %   "logback-core"      % "1.1.3"
libraryDependencies += "ch.qos.logback"      %   "logback-classic"   % "1.1.3"
libraryDependencies += "jline"      %   "jline"   % "2.12.1"
libraryDependencies += "org.apache.spark" % "spark-core_2.11" % sparkV exclude("org.scala-lang","scala-compiler") exclude("jline","jline")
libraryDependencies += "org.apache.spark" % "spark-sql_2.11" % sparkV
libraryDependencies += "com.datastax.spark"  %% "spark-cassandra-connector" % sparkCassandraConnectorV exclude("org.apache.spark","spark-sql_2.11")
libraryDependencies += "com.datastax.cassandra" % "cassandra-driver-core" % cassandraDriverV

mainClass in (Compile, run) := Some("com.tsoft.dreamtel.spark.poc.SparkTest")

val sparkV = "1.5.0"

val sparkCassandraConnectorV = "1.5.0-RC1"

val cassandraDriverV = "3.0.0-rc1"

libraryDependencies += "joda-time" % "joda-time" % "2.9.1"

libraryDependencies += "org.slf4j" % "slf4j-api" % "1.7.10"

libraryDependencies += "ch.qos.logback" % "logback-core" % "1.1.3"

libraryDependencies += "ch.qos.logback" % "logback-classic" % "1.1.3"

libraryDependencies += "jline" % "jline" % "2.12.1"

libraryDependencies += "org.apache.spark" % "spark-core_2.11" % sparkV exclude("org.scala-lang","scala-compiler") exclude("jline","jline")

libraryDependencies += "org.apache.spark" % "spark-sql_2.11" % sparkV

libraryDependencies += "com.datastax.spark" %% "spark-cassandra-connector" % sparkCassandraConnectorV exclude("org.apache.spark","spark-sql_2.11")

libraryDependencies += "com.datastax.cassandra" % "cassandra-driver-core" % cassandraDriverV

mainClass in (Compile, run) := Some("com.tsoft.dreamtel.spark.poc.SparkTest")

A small Scala program to show how it works

SparkTest.scala

package com.tsoft.dreamtel.spark.poc

import org.apache.spark.sql.cassandra.CassandraSQLContext
import org.apache.spark.sql.types.{StringType, StructField, StructType}
import org.apache.spark.sql.{DataFrame, SQLContext}
import com.datastax.spark.connector._
import org.apache.spark.{SparkConf, SparkContext}

object SparkTest {
  def main(args: Array[String]): Unit = {
    testCassandraSQL()
  }

  def testCassandraSQL(): Unit = {
    val conf = new SparkConf(true).set("spark.cassandra.connection.host","127.0.0.1")
    val sc = new SparkContext("local", "Tobias-Local-SPARK-Context", conf)
    val cc = new CassandraSQLContext(sc)
    val sqlrdd: DataFrame = cc.sql("SELECT firstname from playground.individual WHERE firstname like 'L%'") //  WHERE firstname like 'S%'")
    sqlrdd.foreach( e => println("ROW: "+e.getString(0) ) )
  }


  }
}

package com.tsoft.dreamtel.spark.poc

import org.apache.spark.sql.cassandra.CassandraSQLContext

import org.apache.spark.sql.types.{StringType, StructField, StructType}

import org.apache.spark.sql.{DataFrame, SQLContext}

import com.datastax.spark.connector._

import org.apache.spark.{SparkConf, SparkContext}

object SparkTest {

def main(args: Array[String]): Unit = {

testCassandraSQL()

}

def testCassandraSQL(): Unit = {

val conf = new SparkConf(true).set("spark.cassandra.connection.host","127.0.0.1")

val sc = new SparkContext("local", "Tobias-Local-SPARK-Context", conf)

val cc = new CassandraSQLContext(sc)

val sqlrdd: DataFrame = cc.sql("SELECT firstname from playground.individual WHERE firstname like 'L%'") // WHERE firstname like 'S%'")

sqlrdd.foreach( e => println("ROW: "+e.getString(0) ) )

}

The output…

ROW: Leona
ROW: Lillian 
ROW: Liana
ROW: Lilian
ROW: Lovisa
ROW: Layla 
ROW: Lennon 
ROW: Leonidas 
ROW: Lova
ROW: LÃ©on
ROW: LÃ©on
ROW: Laila
ROW: Leonardo

ROW: Leona

ROW: Lillian

ROW: Liana

ROW: Lilian

ROW: Lovisa

ROW: Layla

ROW: Lennon

ROW: Leonidas

ROW: Lova

ROW: LÃ©on

ROW: Laila

ROW: Leonardo

SBT Good to know…

November 5, 2015SBT, Scalatobias

Dependecy problems

I have been having some difficulties figuring out what depends on what. I found the following set plugins which I think can be really helpful;

https://github.com/jrudolph/sbt-dependency-graph

and

https://github.com/gilt/sbt-dependency-graph-sugar

Be sure to install GraphWiz first, I used Homebrew on my Mac

brew install graphviz

and I also had to create a config file

mkdir ~/.sbt/gilt
vi ~/.sbt/gilt/sbt-dependency-graph-sugar-cmd

1 2	mkdir ~/.sbt/gilt vi ~/.sbt/gilt/sbt-dependency-graph-sugar-cmd

with the following content

open -a Safari $1

1	open -a Safari $1

The readme explains how to use it pretty well, simply start sbtÂ CLI

Tobiass-MBP:projectX tobias$ sbt
[info] Loading global plugins from /Users/tobias/.sbt/0.13/plugins
[info] Updating {file:/Users/tobias/.sbt/0.13/plugins/}global-plugins...
Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Loading project definition from /Users/tobias/qvantel/projectX/project
Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...
[info] Set current project to projectX (in build file:/Users/tobias/qvantel/projectX/)
> dependencySvgView

Tobiass-MBP:projectX tobias$ sbt

[info] Loading global plugins from /Users/tobias/.sbt/0.13/plugins

[info] Updating {file:/Users/tobias/.sbt/0.13/plugins/}global-plugins...

Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...

[info] Resolving org.fusesource.jansi#jansi;1.4 ...

[info] Done updating.

[info] Loading project definition from /Users/tobias/qvantel/projectX/project

Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...

[info] Set current project to projectX (in build file:/Users/tobias/qvantel/projectX/)

> dependencySvgView

It will give you a graph that looks something like this (it is in SVG format so it is searchable!!!) Now you should see which package/jar is using which, and also where the different versions clash…

Show the class path for the run command

Tobiass-MBP:projectX tobias$ sbt
[info] Loading global plugins from /Users/tobias/.sbt/0.13/plugins
[info] Loading project definition from /Users/tobias/qvantel/projectX/project
[info] Set current project to projectX (in build file:/Users/tobias/qvantel/projectX/)
> show runtime:fullClasspath
[info] Updating {file:/Users/tobias/qvantel/projectX/}projectx...
[info] Resolving jline#jline;2.12.1 ...
[info] Done updating.
[info] List(Attributed(/Users/tobias/qvantel/projectX/target/scala-2.11/classes), Attributed(/Users/tobias/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.11.7.jar), Attributed(/Users/tobias/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.10.jar), Attributed(/Users/tobias/.ivy2/cache/ch.qos.logback/logback-core/jars/logback-core-1.1.3.jar), Attributed(/Users/tobias/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.1.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-core_2.11/jars/kamon-core_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/com.typesafe.akka/akka-actor_2.11/jars/akka-actor_2.11-2.3.14.jar), Attributed(/Users/tobias/.ivy2/cache/com.typesafe/config/bundles/config-1.2.1.jar), Attributed(/Users/tobias/.ivy2/cache/org.hdrhistogram/HdrHistogram/bundles/HdrHistogram-2.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-akka_2.11/jars/kamon-akka_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-scala_2.11/jars/kamon-scala_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-spray_2.11/jars/kamon-spray_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-can_2.11/bundles/spray-can_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-io_2.11/bundles/spray-io_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-util_2.11/bundles/spray-util_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-http_2.11/bundles/spray-http_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.parboiled/parboiled-scala_2.11/jars/parboiled-scala_2.11-1.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/org.parboiled/parboiled-core/jars/parboiled-core-1.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-client_2.11/bundles/spray-client_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-httpx_2.11/bundles/spray-httpx_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.scala-lang.modules/scala-xml_2.11/bundles/scala-xml_2.11-1.0.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.jvnet.mimepull/mimepull/jars/mimepull-1.9.5.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-routing_2.11/bundles/spray-routing_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/com.chuusai/shapeless_2.11/jars/shapeless_2.11-1.2.4.jar), Attributed(/Users/tobias/.ivy2/cache/org.aspectj/aspectjweaver/jars/aspectjweaver-1.8.7.jar))
[success] Total time: 1 s, completed Nov 5, 2015 10:21:30 AM
> 
>

Tobiass-MBP:projectX tobias$ sbt

[info] Loading global plugins from /Users/tobias/.sbt/0.13/plugins

[info] Loading project definition from /Users/tobias/qvantel/projectX/project

[info] Set current project to projectX (in build file:/Users/tobias/qvantel/projectX/)

> show runtime:fullClasspath

[info] Updating {file:/Users/tobias/qvantel/projectX/}projectx...

[info] Resolving jline#jline;2.12.1 ...

[info] Done updating.

[info] List(Attributed(/Users/tobias/qvantel/projectX/target/scala-2.11/classes), Attributed(/Users/tobias/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.11.7.jar), Attributed(/Users/tobias/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.10.jar), Attributed(/Users/tobias/.ivy2/cache/ch.qos.logback/logback-core/jars/logback-core-1.1.3.jar), Attributed(/Users/tobias/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.1.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-core_2.11/jars/kamon-core_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/com.typesafe.akka/akka-actor_2.11/jars/akka-actor_2.11-2.3.14.jar), Attributed(/Users/tobias/.ivy2/cache/com.typesafe/config/bundles/config-1.2.1.jar), Attributed(/Users/tobias/.ivy2/cache/org.hdrhistogram/HdrHistogram/bundles/HdrHistogram-2.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-akka_2.11/jars/kamon-akka_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-scala_2.11/jars/kamon-scala_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.kamon/kamon-spray_2.11/jars/kamon-spray_2.11-0.5.2.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-can_2.11/bundles/spray-can_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-io_2.11/bundles/spray-io_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-util_2.11/bundles/spray-util_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-http_2.11/bundles/spray-http_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.parboiled/parboiled-scala_2.11/jars/parboiled-scala_2.11-1.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/org.parboiled/parboiled-core/jars/parboiled-core-1.1.7.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-client_2.11/bundles/spray-client_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-httpx_2.11/bundles/spray-httpx_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.scala-lang.modules/scala-xml_2.11/bundles/scala-xml_2.11-1.0.3.jar), Attributed(/Users/tobias/.ivy2/cache/org.jvnet.mimepull/mimepull/jars/mimepull-1.9.5.jar), Attributed(/Users/tobias/.ivy2/cache/io.spray/spray-routing_2.11/bundles/spray-routing_2.11-1.3.3.jar), Attributed(/Users/tobias/.ivy2/cache/com.chuusai/shapeless_2.11/jars/shapeless_2.11-1.2.4.jar), Attributed(/Users/tobias/.ivy2/cache/org.aspectj/aspectjweaver/jars/aspectjweaver-1.8.7.jar))

[success] Total time: 1 s, completed Nov 5, 2015 10:21:30 AM

Create an MBean (JMX) in Scala

November 3, 2015Uncategorizedtobias

Create the MBean like this

trait OrderTrackerMBean {
  def getOrderId : Int
  def setOrderId(orderId:Int)
}

class OrderTracker extends OrderTrackerMBean {
  var orderId = 0
  override def getOrderId: Int = orderId
  override def setOrderId(_orderId: Int)= {
    orderId = _orderId
  }

}

trait OrderTrackerMBean {

def getOrderId : Int

def setOrderId(orderId:Int)

}

class OrderTracker extends OrderTrackerMBean {

var orderId = 0

override def getOrderId: Int = orderId

override def setOrderId(_orderId: Int)= {

orderId = _orderId

}

NOTE, that the interface/trait must end with MBean in the name

And this is how you register your MBean

package com.tsoft.playingWithLogback

import java.lang.management.ManagementFactory
import javax.management.{ObjectName, MBeanServer}

import org.slf4j.{MarkerFactory, Marker, LoggerFactory}
import org.slf4j.MDC
import scala.concurrent.{Await, Future}
import scala.concurrent.duration._
import scala.concurrent.ExecutionContext.Implicits.global

object LotsOfLogOutput {

  val logger = LoggerFactory.getLogger(this.getClass)

  val orderTrackerBean = new OrderTracker
  val mbs:MBeanServer = ManagementFactory.getPlatformMBeanServer();
  val mBeanName:ObjectName = new ObjectName("com.tsoft.playingWithLogback:type=Tracking");
  mbs.registerMBean( orderTrackerBean, mBeanName);

...

package com.tsoft.playingWithLogback

import java.lang.management.ManagementFactory

import javax.management.{ObjectName, MBeanServer}

import org.slf4j.{MarkerFactory, Marker, LoggerFactory}

import org.slf4j.MDC

import scala.concurrent.{Await, Future}

import scala.concurrent.duration._

import scala.concurrent.ExecutionContext.Implicits.global

object LotsOfLogOutput {

val logger = LoggerFactory.getLogger(this.getClass)

val orderTrackerBean = new OrderTracker

val mbs:MBeanServer = ManagementFactory.getPlatformMBeanServer();

val mBeanName:ObjectName = new ObjectName("com.tsoft.playingWithLogback:type=Tracking");

mbs.registerMBean( orderTrackerBean, mBeanName);

...

And the simply launch Java Mission Control (imc), attach to the JVM, and modify your MBean attributes as you like.

Enjoy!

SBT module not found, why ?

November 3, 2015Uncategorizedtobias

I have an build.sbt file that looks like this

name := "TobiasPlayground"

version := "1.0"

scalaVersion := "2.11.7"

scalacOptions := Seq("-unchecked", "-deprecation", "-encoding", "utf8")

libraryDependencies ++= {
  val akkaV = "2.3.9"
  val sprayV = "1.3.3"
  Seq(
    "io.spray"            %%  "spray-client"  % sprayV,
    "io.spray"            %%  "spray-can"     % sprayV,
    "io.spray"            %%  "spray-routing" % sprayV,
    "io.spray"            %%  "spray-testkit" % sprayV  % "test",
    "com.typesafe.akka"   %%  "akka-actor"    % akkaV,
    "com.typesafe.akka"   %%  "akka-testkit"  % akkaV   % "test",
    "org.specs2"          %%  "specs2-core"   % "2.3.11" % "test",
    "org.slf4j"           %%   "slf4j-api"      % "1.7.10"
  )
}

name := "TobiasPlayground"

version := "1.0"

scalaVersion := "2.11.7"

scalacOptions := Seq("-unchecked", "-deprecation", "-encoding", "utf8")

libraryDependencies ++= {

val akkaV = "2.3.9"

val sprayV = "1.3.3"

Seq(

"io.spray" %% "spray-client" % sprayV,

"io.spray" %% "spray-can" % sprayV,

"io.spray" %% "spray-routing" % sprayV,

"io.spray" %% "spray-testkit" % sprayV % "test",

"com.typesafe.akka" %% "akka-actor" % akkaV,

"com.typesafe.akka" %% "akka-testkit" % akkaV % "test",

"org.specs2" %% "specs2-core" % "2.3.11" % "test",

"org.slf4j" %% "slf4j-api" % "1.7.10"

)

}

But for some reason I can’t get slf4j downloaded from the Maven repository (http://mvnrepository.com)

If I search the Maven Repository, I can clearly see that the version I intend to use is there.

Running “sbt compile” from the command line will result in the following output, and here it is time to pay attention to the details, look at what it is trying to do !!!

Tobiass-MBP:TobiasPlayground tobias$ sbt compile
[info] Loading project definition from /Users/tobias/qvantel/TobiasPlayground/project
Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...
[info] Set current project to TobiasPlayground (in build file:/Users/tobias/qvantel/TobiasPlayground/)
[info] Updating {file:/Users/tobias/qvantel/TobiasPlayground/}tobiasplayground...
Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...
[info] Resolving org.slf4j#slf4j-api_2.11;1.7.10 ...
[warn] 	module not found: org.slf4j#slf4j-api_2.11;1.7.10
[warn] ==== local: tried
[warn]   /Users/tobias/.ivy2/local/org.slf4j/slf4j-api_2.11/1.7.10/ivys/ivy.xml
[warn] ==== jcenter: tried
[warn]   https://jcenter.bintray.com/org/slf4j/slf4j-api_2.11/1.7.10/slf4j-api_2.11-1.7.10.pom
[warn] ==== public: tried
[warn]   https://repo1.maven.org/maven2/org/slf4j/slf4j-api_2.11/1.7.10/slf4j-api_2.11-1.7.10.pom
[info] Resolving jline#jline;2.12.1 ...
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn] 	::          UNRESOLVED DEPENDENCIES         ::
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn] 	:: org.slf4j#slf4j-api_2.11;1.7.10: not found
[warn] 	::::::::::::::::::::::::::::::::::::::::::::::
[warn] 
[warn] 	Note: Unresolved dependencies path:
[warn] 		org.slf4j:slf4j-api_2.11:1.7.10 (/Users/tobias/qvantel/TobiasPlayground/build.sbt#L9-27)
[warn] 		  +- default:tobiasplayground_2.11:1.0

Tobiass-MBP:TobiasPlayground tobias$ sbt compile

[info] Loading project definition from /Users/tobias/qvantel/TobiasPlayground/project

Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...

[info] Set current project to TobiasPlayground (in build file:/Users/tobias/qvantel/TobiasPlayground/)

[info] Updating {file:/Users/tobias/qvantel/TobiasPlayground/}tobiasplayground...

Waiting for lock on /Users/tobias/.ivy2/.sbt.ivy.lock to be available...

[info] Resolving org.slf4j#slf4j-api_2.11;1.7.10 ...

[warn] module not found: org.slf4j#slf4j-api_2.11;1.7.10

[warn] ==== local: tried

[warn] /Users/tobias/.ivy2/local/org.slf4j/slf4j-api_2.11/1.7.10/ivys/ivy.xml

[warn] ==== jcenter: tried

[warn] https://jcenter.bintray.com/org/slf4j/slf4j-api_2.11/1.7.10/slf4j-api_2.11-1.7.10.pom

[warn] ==== public: tried

[warn] https://repo1.maven.org/maven2/org/slf4j/slf4j-api_2.11/1.7.10/slf4j-api_2.11-1.7.10.pom

[info] Resolving jline#jline;2.12.1 ...

[warn] ::::::::::::::::::::::::::::::::::::::::::::::

[warn] :: UNRESOLVED DEPENDENCIES ::

[warn] ::::::::::::::::::::::::::::::::::::::::::::::

[warn] :: org.slf4j#slf4j-api_2.11;1.7.10: not found

[warn] ::::::::::::::::::::::::::::::::::::::::::::::

[warn]

[warn] Note: Unresolved dependencies path:

[warn] org.slf4j:slf4j-api_2.11:1.7.10 (/Users/tobias/qvantel/TobiasPlayground/build.sbt#L9-27)

[warn] +- default:tobiasplayground_2.11:1.0

As you can see above the package (jar) it tries to download is not slf4j-api it is slf4j-api_2.11;1.7.10

The build.sbt file uses the double and single % (percent) character and this is what makes the difference. Â The %% makes SBT append the project specified scala version to the package name, resulting in a name “slf4j-api_2.11”.

BUT that name does not exist in the Maven Repository, however, the “slf4j-api” does

So by simply choosing one instead of two %, the problem will go away 🙂

Thus, the built.sbt should look like this instead

name := "TobiasPlayground"

version := "1.0"

scalaVersion := "2.11.7"

scalacOptions := Seq("-unchecked", "-deprecation", "-encoding", "utf8")

libraryDependencies ++= {
  val akkaV = "2.3.9"
  val sprayV = "1.3.3"
  Seq(
    "io.spray"            %%  "spray-client"  % sprayV,
    "io.spray"            %%  "spray-can"     % sprayV,
    "io.spray"            %%  "spray-routing" % sprayV,
    "io.spray"            %%  "spray-testkit" % sprayV  % "test",
    "com.typesafe.akka"   %%  "akka-actor"    % akkaV,
    "com.typesafe.akka"   %%  "akka-testkit"  % akkaV   % "test",
    "org.specs2"          %%  "specs2-core"   % "2.3.11" % "test",
    "org.slf4j"           %   "slf4j-api"      % "1.7.10"
  )
}

name := "TobiasPlayground"

version := "1.0"

scalaVersion := "2.11.7"

scalacOptions := Seq("-unchecked", "-deprecation", "-encoding", "utf8")

libraryDependencies ++= {

val akkaV = "2.3.9"

val sprayV = "1.3.3"

Seq(

"io.spray" %% "spray-client" % sprayV,

"io.spray" %% "spray-can" % sprayV,

"io.spray" %% "spray-routing" % sprayV,

"io.spray" %% "spray-testkit" % sprayV % "test",

"com.typesafe.akka" %% "akka-actor" % akkaV,

"com.typesafe.akka" %% "akka-testkit" % akkaV % "test",

"org.specs2" %% "specs2-core" % "2.3.11" % "test",

"org.slf4j" % "slf4j-api" % "1.7.10"

)

}

For reference go toÂ https://www.playframework.com/documentation/2.1.1/SBTDependenciesÂ to read more about how SBT handles decencies and the % and %%.

I read this article to finally get this rightÂ http://stackoverflow.com/questions/17461453/build-scala-and-symbols-meaning

See who is connected to the same network / WIFI

October 11, 2015Uncategorizedtobias

There are tools out there, such as Angry IP Scanner, iNet or IP Scanner, Â but this can easily be done using a bash script, not as nice looking perhaps but it does the job.

The script :

#!/bin/bash
for i in {0..255}
do
	cmd="nslookup 192.168.1."
	cmd=$cmd$i
	result=$($cmd|egrep "Address|name")
	echo "****************"
	echo $cmd
	echo $result
done

#!/bin/bash

for i in {0..255}

cmd="nslookup 192.168.1."

cmd=$cmd$i

result=$($cmd|egrep "Address|name")

echo "****************"

echo $cmd

echo $result

done

Which should give you an output that looks like this

****************
nslookup 192.168.1.84
Address: 192.168.1.254#53
****************
nslookup 192.168.1.85
Address: 192.168.1.254#53
****************
nslookup 192.168.1.86
Address: 192.168.1.254#53 86.1.168.192.in-addr.arpa name = Tobiass-iMac.lan.
****************
nslookup 192.168.1.87
Address: 192.168.1.254#53 87.1.168.192.in-addr.arpa name = raspberrypi.lan.
****************
nslookup 192.168.1.88
Address: 192.168.1.254#53 88.1.168.192.in-addr.arpa name = Lindas-iPad.lan.
****************
nslookup 192.168.1.89
Address: 192.168.1.254#53
****************

****************

nslookup 192.168.1.84

Address: 192.168.1.254#53

****************

nslookup 192.168.1.85

Address: 192.168.1.254#53

****************

nslookup 192.168.1.86

Address: 192.168.1.254#53 86.1.168.192.in-addr.arpa name = Tobiass-iMac.lan.

****************

nslookup 192.168.1.87

Address: 192.168.1.254#53 87.1.168.192.in-addr.arpa name = raspberrypi.lan.

****************

nslookup 192.168.1.88

Address: 192.168.1.254#53 88.1.168.192.in-addr.arpa name = Lindas-iPad.lan.

****************

nslookup 192.168.1.89

Address: 192.168.1.254#53

****************

That’s it

-Tobias

Övervakning av min IVT-490 värmepump med Raspberry Pi

March 8, 2015Raspberry Pitobias

I denna artikeln ska jag försöka beskriva mitt lilla projekt med att övervaka min IVT-490 värmepump med en Raspberry P.

Jag har hämtat mycket kunskap från dessa två forum-trådar :
http://www.varmepumpsforum.com/vpforum/index.php?topic=27306.15Tanken
och
http://www.byggahus.se/forum/varme-allmant/44487-prata-med-ivt-490-a-5.html

Min värmepump har ett interface som ser ut såhär :

Man behöver slå på variabeldumpning på pannan för att få ut information. Man kommer in i Admin mode genom att hålla in högra knappen i 5-10 sekunder. Sedan letar man upp “Installation och igångkörning” och där finner man “Variabeldumpning till PC”. Med det påslaget så får man ut data 1 gång per minut. (source; Niclas Hedlund)

Citerar Niclas.Hedlund om interfacet från Värmepumpsforum:

Baudraten är 9600baud och 8 databitar, 1stopbit och ingen paritet.
Tänk på att TxD som är markerat på bilden är data UT från pumpen, och RxD data IN till pumpen.

Då jag inte lyckats få tag på en kontakt så fick jag använda mig av en plastpåseklämma (som man köper på MAXI) som jag vänt på och satt två skruvar i, och så har jag silvertejp också…. ja ja det är ju på egen risk 🙂

EDIT: Nu funkade inte min plastklämma så bra så jag lödde dit trådarna istället, nu funkar det bättre. MEN så hörde Fredrik Winkvist av sig och berättade vilken kontakt man skulle ha, och den ska funka perfekt. För er som söker så heter den “2.54mm Pitch 2×5 Pin Double Row Angle IDC Pin Headers 10 Pins”. Ett stort Tack till Fredrik, här är en länk till eBay som säkert blir outdated men så länge den finns kvar kan länken vara bra: http://www.ebay.com/itm/20-Pcs-2-54mm-Pitch-2×5-Pin-Double-Row-Angle-IDC-Pin-Headers-10-Pins-/310784076520?pt=LH_DefaultDomain_0&hash=item485c2caae8

Specification:

Product Name	IDC Pin Header
Position	5
Pin Number	10
Row	2
Mounting Angle	90 Degree
Pin Pitch	2.54mm/0.1″
Pin Length	4mm/ 0.16″ 12mm/ 0.47″
Total Size	19 x 9.5 x 22mm/ 0.75″ x 0.37″ x 0.87″ ( LWH)
Material	Plastic, Metal
Color	Black, Silver Tone
Net Weight	66g
Package Content	20 x Angle IDC Pin Headers

Description:

Features double row, 90 degree mounting angle, male pin header, electronic component, IDC connector.

This pin header is an ideal connector for the PCB board and intergrated circuit, used widely in the computer, breadboard, LCD, TV and other home appliances.

När detta var gjort var jag tvungen att koppla in det via typ USB, så jag köpte en sådan

här på ebay. http://www.ebay.co.uk/itm/6PIN-CP2102-USB-2-0-to-UART-TTL-Electronic-Connector-Serial-Converter-Module-/390568169609?pt=UK_Computing_Parallel_Serial_PS_2&hash=item5aefad5089
Varje minut så skickar den ut 37-parametrar som är ;-separerade, se EXCEL filen; Loggning-2. (loggfilen kommer också från Värmepumpsforumet; inskickat av Larsmaja)

En rad kan se ut såhär :

360;   315;    33;   478;   445;   447;  -512;   774;  -512;0;0;0;0;1;0;0;1;1;0;0;   296;   311;   326;   341;   495;   520;   545;   301;   326;   351;   435;   105;    26;     0;     0;     0;     0

1	360; 315; 33; 478; 445; 447; -512; 774; -512;0;0;0;0;1;0;0;1;1;0;0; 296; 311; 326; 341; 495; 520; 545; 301; 326; 351; 435; 105; 26; 0; 0; 0; 0

Där alla temperaturer är heltal med 1 decimals noggrannhet, så 315 betyder 31,5 grader Celsius.
360 är sekvensummer
315 är Framledningstemperatur (GT1), dvs 31,5 grader
33 är Utetemperatur (GT2), dvs 3,1 grader
478 är Tapvarmvatten (GT3-1), dvs 47,8 grader
445 är Varmvatten(GT3-2), dvs 44,5 grader
447 är Värmevatten(GT3-3), dvs 44,7 grader
-512 är Rumstemperatur(GT5), men jag har inte den givaren så den visar -512
774 är Hetgastemperatur(GT6), dvs 77,4 grader

  root["framledn"] = ivt[1]; //Framledning
  root["ute"] = ivt[2]; //Ute
  root["tappvarmvtopp"] = ivt[3]; //Tappvarmvatten Topp
  root["varmevmitt"] = ivt[4]; //Varmvatten Mitt
  root["varmevbotton"] = ivt[5]; //Värmevatten Botten
  root["inne"] = ivt[6]; //Rumstemp
  root["hetgas"] = ivt[7]; //Hetgas
  root["egtemp"] = ivt[8]; //Extra Acc-Tank
  root["tryckvakt"] = ivt[9]; //Tryckvakt
  root["hogtryck"] = ivt[10]; //Högtryck
  root["lagtryck"] = ivt[11]; //Lågtryck
  root["egsemester"] = ivt[12]; //Semester aktiv?
  root["kompressor"] = ivt[13]; //Kompressor aktiv
  root["schuntoppen"] = ivt[14]; //SV1 Öppna
  root["schuntstangd"] = ivt[15]; //SV1 Stäng
  root["cirkpump"] = ivt[16]; //P1 Rad
  //root["flakt"] = ivt[17]; //Fläkt
  root["larm"] = ivt[18]; //Larm aktiv
  //root["20"] = ivt[19]; //Extern P2
  //root["21"] = ivt[20]; //LLT GT1
  //root["22"] = ivt[21]; //LL GT1
  root["bvframledning"] = ivt[22]; //BV GT1
  //root["24"] = ivt[23]; //UL GT1
  //root["25"] = ivt[24]; //LL GT3:2
  //root["26"] = ivt[25]; //ULT GT3:2
  //root["27"] = ivt[26]; //UL GT3:2
  //root["28"] = ivt[27]; //LL GT3:3
  //root["29"] = ivt[28]; //BV GT3:3
  root["extravv1"] = ivt[29]; //SV3 BV Förskj
  root["extravv2"] = ivt[30]; //Effekt ink vit VV behov
  root["extravv3"] = ivt[31]; //Tillskotstimer VV behov
  //root["33"] = ivt[32];   //Tappv prio
  root["elpatron"] = ivt[33]; //Tillskott i %/10
  //root["35"] = ivt[34]; //Tillskott RAD
  root["extravv4"] = ivt[35]; //Tillskott Tillägg
  //root["37"] = ivt[36]; //Default SV2 Open

root["framledn"] = ivt[1]; //Framledning

root["ute"] = ivt[2]; //Ute

root["tappvarmvtopp"] = ivt[3]; //Tappvarmvatten Topp

root["varmevmitt"] = ivt[4]; //Varmvatten Mitt

root["varmevbotton"] = ivt[5]; //Värmevatten Botten

root["inne"] = ivt[6]; //Rumstemp

root["hetgas"] = ivt[7]; //Hetgas

root["egtemp"] = ivt[8]; //Extra Acc-Tank

root["tryckvakt"] = ivt[9]; //Tryckvakt

root["hogtryck"] = ivt[10]; //Högtryck

root["lagtryck"] = ivt[11]; //Lågtryck

root["egsemester"] = ivt[12]; //Semester aktiv?

root["kompressor"] = ivt[13]; //Kompressor aktiv

root["schuntoppen"] = ivt[14]; //SV1 Öppna

root["schuntstangd"] = ivt[15]; //SV1 Stäng

root["cirkpump"] = ivt[16]; //P1 Rad

//root["flakt"] = ivt[17]; //Fläkt

root["larm"] = ivt[18]; //Larm aktiv

//root["20"] = ivt[19]; //Extern P2

//root["21"] = ivt[20]; //LLT GT1

//root["22"] = ivt[21]; //LL GT1

root["bvframledning"] = ivt[22]; //BV GT1

//root["24"] = ivt[23]; //UL GT1

//root["25"] = ivt[24]; //LL GT3:2

//root["26"] = ivt[25]; //ULT GT3:2

//root["27"] = ivt[26]; //UL GT3:2

//root["28"] = ivt[27]; //LL GT3:3

//root["29"] = ivt[28]; //BV GT3:3

root["extravv1"] = ivt[29]; //SV3 BV Förskj

root["extravv2"] = ivt[30]; //Effekt ink vit VV behov

root["extravv3"] = ivt[31]; //Tillskotstimer VV behov

//root["33"] = ivt[32]; //Tappv prio

root["elpatron"] = ivt[33]; //Tillskott i %/10

//root["35"] = ivt[34]; //Tillskott RAD

root["extravv4"] = ivt[35]; //Tillskott Tillägg

//root["37"] = ivt[36]; //Default SV2 Open

I bilden nedan ser man de olika givarna GT1-7.

På min Raspberry pi skrev jag ett enkelt script som läser från USB-serieporten och postar på en websida som jag har gjort, där jag helt enkelt lägger in det i en MySQL databas )oerhört enkelt, bara timestamp och så det ;-separerade datan (två kolumner, pga av att jag ville komma igång, skulle såklart haft 38 kolumner så man kunde göra lite mer SQL, men det får bli en annan gång…)

import requests
import serial
import time
from time import gmtime, strftime
import re

pattern = re.compile(r'\s+')

def readlineCR(port):
	rv = ""
	while True:
		ch = port.read()
		rv += ch
		if ch == '\r' or ch == '':
			return rv

def post(timestamp,data) :
	payload = {'timestamp': timestamp, 'data': data}
	try :
		r = requests.post("http://domain.com/path/file.php", data=payload)
		print(r.text)
	except Exception as e:
		print "Oops! unable to post result!",e.__doc__,e.message


port = serial.Serial("/dev/ttyUSB0", baudrate = 9600, timeout = 60)

while True: 
	rcv=''
	try :
		rcv = readlineCR(port)
	except Exception as e:
		print "Oops! problems reading from USB!"
		print e.__doc__
		print e.message
	rcv = re.sub(pattern, '',rcv)
	timeStamp = strftime("%Y-%m-%d %H:%M:%S", gmtime())
	print(timeStamp+rcv)
	if rcv :
		post( timeStamp,rcv)
	else :
		print "Empty data..."

import requests

import serial

import time

from time import gmtime, strftime

import re

pattern = re.compile(r'\s+')

def readlineCR(port):

rv = ""

while True:

ch = port.read()

rv += ch

if ch == '\r' or ch == '':

return rv

def post(timestamp,data) :

payload = {'timestamp': timestamp, 'data': data}

try :

r = requests.post("http://domain.com/path/file.php", data=payload)

print(r.text)

except Exception as e:

print "Oops! unable to post result!",e.__doc__,e.message

port = serial.Serial("/dev/ttyUSB0", baudrate = 9600, timeout = 60)

while True:

rcv=''

try :

rcv = readlineCR(port)

except Exception as e:

print "Oops! problems reading from USB!"

print e.__doc__

print e.message

rcv = re.sub(pattern, '',rcv)

timeStamp = strftime("%Y-%m-%d %H:%M:%S", gmtime())

print(timeStamp+rcv)

if rcv :

post( timeStamp,rcv)

else :

print "Empty data..."

Jag har noterat att ibland så ramlar mina trådar ur, och så får jag inget resultat, då blir serieporten inte nåbar 🙂 och då får jag lite roliga felutskrifter… och såklart blir diagrammen dåligt uppdaterade….

Jag har gjort en websida (PHP and Javascript) där jag använt Highcharts för att rendera diagrammen. Ta en titt här http://tsoft.se/varmepanna/

Fredrik Winkvist var dessutom lite uppfinningsrik och berättade att man använda strömförsörjningen från värmepumpens 5Volt ut till Raspberry Pi;n. Ta en kik på bilden nedan.

Förbättringsförslag är alltid välkomna, så hör av er !

Mitt nästa projekt, när jag får tid…. är att mäta strömförbrukningen hemma…

-Tobias

Calculate the minimum waste when cutting planks…

July 10, 2014optimization, tool, webtobias

I made a web application which will calculate the most optimum layout of your pieces you would like to cut from a plank. This helps in figuring out how many planks of a certain size you would have to buy, and also gives you which pieces should be cut out on each plank.

Not sure how many times I have been sitting there, trying to figure out how many to buy, and now I simply thought that a small web-app would be nice. In fact I tried to google this, but it turns out that most people say stuff like, well add 10-15% to the total length, but that just does not work for me, that is way to inaccurate.

This page is currently in Swedish only, but until it has been translated, I bet you will understand anyway, the user interface is pretty easy to use (should not require any translation I think)…

anyway, here is the link; spill.tsoft.se

Enjoy!

-Tobias