| Feed Preview | Feed Preview |
![]() |
|
|
|
Link: http://forums.pentaho.com/
Description: ETL jobs, ETL transforms, Spoon, Carte...
Published: Wednesday June 19th 7AM
Link: http://forums.pentaho.com/showthre...manner-in-pentaho-kettle&goto=newpost
Description: Hi, i have an excel input like below. And i want to insert them into database in parent-child manner. parent code child code AB CD CD EF EF GH GH AB But i want to restrict the value of 4th row. As it will go into infinite loop. thanks in advance read more »
Published: Wednesday June 19th 5AM
Link: http://forums.pentaho.com/showthre...Splitting-the-Date-field&goto=newpost
Description: Hi all, I need to split date which is in the format "7/12/2013" and get output as 2013-12-07. I used the below code which works perfectly fine on JS editor but the Pentaho output I get " in few places like 2013-NaN-12 or 2013-nan-nan and such //var Opt_In_Date = "7/12/2013"; var datestring = Opt_In_Date.split "/" ; var dt1 = datestring 0 ; var mon1 = datestring 1 ; var yr1 = datestring 2 ; if dt1<10 dt1 = '0'+dt1 ; if mon1<10 mon1 = '0'+mon1 ; var DATE_OF... read more »
Published: Wednesday June 19th 4AM
Link: http://forums.pentaho.com/showthre...ns-for-you-about-roadmap&goto=newpost
Description: Hi, I have some questions for you about roadmap..Please give me some advice. 1. Could you explain your public or privateroadmap for years to come We expect to know your development plan by year asdetail as possible. If you have no plan, please tell me your opinion. 2. Could youdescribe the list of technologies in your open source Please describe asdetail as possible. 3. What technologiesdo you need more in your open source project Why 4. Whatnew open source project do you want to create in Big D... read more »
Published: Tuesday June 18th 4PM
Link: http://forums.pentaho.com/showthre...tle-and-LibreOffice-Base&goto=newpost
Description: Hello, is it possible to use Kettle to access a database created with LibreOffice file with .odb extension I think LibreOffice Base uses Hypersonic HSQLDB . So I tried to make a database connection using Hypersonic connection type and Native JDBC . I left the fields Host Name, Port Number, User Name and Password blank. And in the Database Name field I put the path to the .odb file. The connection seems to work OK, but in the end it doesn't show any table only metadata . read more »
Published: Tuesday June 18th 1PM
Link: http://forums.pentaho.com/showthre...-to-create-a-Custom-Step&goto=newpost
Description: Hi my name is davidson and i am a brazilian software developer , I'm trying to create a step that will execute an algorithm in r that will bring me 2 outputs, and I wish my step had 2 different outputs and the User to choose where they would each output. My english is not the best sry about that. Something like the image below: Captura de tela de 2013-06-18 14:29:42.jpg Is possible And is there any example or something I can use as a basis Thx., Attached Images Captura de tela de 2013-06-18 14:2... read more »
Published: Tuesday June 18th 10AM
Link: http://forums.pentaho.com/showthre...p 144531-LDAP-Output-SSL&goto=newpost
Description: I'm trying to build an Integrated Management System in order to create an Active Directory account automatically each time the HR program creates a new employee. I'm able to create the active directory user with all the needed fields, but I cannot change its password. In Active Directory, you must login with SSL to the AD and update the unicodePwd field. I cannot SSL login to AD with the ETL although I have correctly set the trust store path and the certificate. I can SSL login with java code. E... read more »
Published: Tuesday June 18th 10AM
Link: http://forums.pentaho.com/showthre...s-in-pentaho-artifactory&goto=newpost
Description: I check http://repository.pentaho.org/artifa...earch/artifact for kettle-vfs artifact, but doesn't find any version. The latest stable build 4.4.0 use 20100924 version. As i see, there is very similar artifact: > >commons-vfs</groupId> >commons-vfs</artifactId> >20091118-pentaho</version> </dependency> wich is predecessor of kettle-vfs, as i think. Should i use it in my maven project, or that isn't right Maybe you will deploy correct version to artifactory Tha... read more »
Published: Tuesday June 18th 6AM
Link: http://forums.pentaho.com/showthre...not-able-to-conect-HIVE2&goto=newpost
Description: Hi Using the trial version for evaluation Trying to connect HIVE2 server implementation through Pentaho Data Integration but not able to connect. Getting below error message Error connecting to database Hive : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: using class org.apache.hadoop.hive.jdbc.HiveDriver Could not establish connecton to jdbc:hive://10.80.31.69:10000/default: java.net.SocketException: Ma... read more »
Published: Tuesday June 18th 4AM
Link: http://forums.pentaho.com/showthre...processing-step-in-spoon&goto=newpost
Description: Exception in thread "Thread-4253" java.lang.IllegalArgumentException: Comparison method violates its general contract at java.util.TimSort.mergeHi TimSort.java:868 at java.util.TimSort.mergeAt TimSort.java:485 at java.util.TimSort.mergeCollapse TimSort.java:410 at java.util.TimSort.sort TimSort.java:214 at java.util.TimSort.sort TimSort.java:173 at java.util.Arrays.sort Arrays.java:659 at java.util.Collections.sort Collections.java:217 at org.pentaho.di.trans.TransMeta.sortStepsNatural... read more »
Published: Tuesday June 18th 4AM
Link: http://forums.pentaho.com/showthre...4504-create-excel-report&goto=newpost
Description: Hi I have 10 records no. of records are not fixed in sql server table. i have to generate excel files from 10 records on the basis of " column in the table. Is it possible to generate excel files from the below table . Please see the attachment . For the below data , i have to generate 5 excel files. thanks Sandhya read more »
Published: Monday June 17th 11PM
Link: http://forums.pentaho.com/showthre...es-against-same-database&goto=newpost
Description: Hi, I have several table input steps running in parallel, which are connected to same SQL Server database and writing it to separate flat files inside the same folder.The configuration details of database and the text file are coming from variables. My problem is , If 2 flows Table input ---> TFO starts at the same time, 2 queries are being fired to two different tables of say 1000k records in each, but time for reading from the database and usage of buffer memory to write the flat file diffe... read more »
Published: Monday June 17th 8PM
Link: http://forums.pentaho.com/showthre...144487-Shell-Script-Help&goto=newpost
Description: Hey All, I'm trying to do something that seems like it should be simple: I'm trying to execute a different shell script for every input row. It's a result set of dates- I want to run a shell script multiple times with that date passed as an argument. It seems like execute shell script doesn't like being passed the result set, and it also seems like it's ignoring the working directory it's executing in the Pentaho directory regardless of what I put in the WD box . Am I totally barking up the wron... read more »
Published: Monday June 17th 10AM
Link: http://forums.pentaho.com/showthre...en-cmd-line-and-log-file&goto=newpost
Description: How can I get log filename from kitchen.bat -log='filename' Thanks read more »
Published: Monday June 17th 9AM
Link: http://forums.pentaho.com/showthre...formation-directory-name&goto=newpost
Description: Hi, I don't know if this has been answered elsewhere in the forum, but is there a way to fetch transformation directory and filename as Internal.Transformation.Filename.Directory yields null value. thanks rajparameterize.jpg Attached Images parameterize.jpg 12.6 KB read more »
Published: Monday June 17th 8AM
Link: http://forums.pentaho.com/showthre...44454-Deleting-all-mails&goto=newpost
Description: hi all i am using GET MAILS POP3/IMAP step to delete all mails in all folders in gmail-adress. i set it like: imap.gmail.com use SSL, port:993 username, password Protokol: IMAP Action: Delete messages Folder: GMAIL/All messages Get all messages it is giving me an error: 2013/06/17 14:31:04 - GMAIL entleeren - ERROR version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy : Unexpected error: null 2013/06/17 14:31:04 - GMAIL entleeren - ERROR version 4.2.0-stable, build 15748 from 20... read more »
Published: Monday June 17th 7AM
Link: http://forums.pentaho.com/showthre...-via-MAIL-NO-SMTP-SERVER&goto=newpost
Description: hi all For now i am using smtp.gmail.com for sending datas via emails. We do have no own smtp-server, but vpn. Now i learnt that gmail allows sending datas in a limited amount not more than 25MB . What other variants do i have to send big datas more than limited in gmail without own smtp-server Any suggestions are appreciated, thank you in advance read more »
Published: Sunday June 16th 9AM
Link: http://forums.pentaho.com/showthre...ter-to-use-for-filtering&goto=newpost
Description: Hi guys, I got one question: Using Carte I would like to pass a parameter/variable into a given KTR to filter excel-rows according to the value of this parameter. While it is rather obvious to use such parameter/variable inside a "Table Input" step I could not figure an approach for applying such filter-logic to get only specific rows from an Excel-File. Does somebody have a good/usable idea/input on that Thx and best regards, Tom read more »
Published: Sunday June 16th 9AM
Link: http://forums.pentaho.com/showthre...h-Git- on-GitHub -advice&goto=newpost
Description: Hi I am currently working on a project revolving around importing the Eurostat database provided as SDMX files into a local database Postgres using Kettle. When I am done with this step I plan to set up an MDX access to the data via Mondrian. The ultimate goal then is to examin the data using Weka and other non-Pentaho tools. Naturally I would like to version and organize this project and my experience tells me that Git with a GitHub repo will be a good choice. I have only mild experience in pro... read more »
Published: Saturday June 15th 10AM
Link: http://forums.pentaho.com/showthre...les-to-Mysql-with-Kettle&goto=newpost
Description: Hello, I'm new in pentaho. I have 2 excel tables : table1 A, B, C, D and table2 A, B, E, F . I want to merge these two tables using Keetle to have as a result one MySql table3 A, B, D for exemple. Can you tell me how can I do this please Regards. read more »
Published: Saturday June 15th 12AM
Link: http://forums.pentaho.com/showthre...es-and-String-conversion&goto=newpost
Description: I have a column which is text in excel containing text, numbers and dates. When i import the excel file in data integrator and mask the column by using " in the fields tab my date fields for that column get the '#' value. Cannot have that happen. How do i get the correct values from excel to display in the data integrator is there an element i got to use which will enable me to get the right values from excel to ETL Thanks read more »
Published: Friday June 14th 2PM
Link: http://forums.pentaho.com/showthre...-string-or-buffer-length&goto=newpost
Description: I am just working on my local laptop running the following locally on my machine... 64 bit version of Windows 7, the 64 bit JDK and JRE, MS SQLServer 2008 R2 and I downloaded the open source version of Pentaho Data Integration from Source Forge version 4.4.0 stable . When I first go in and set up my database connection with the database connection wizard I get the "Connection to the database mydatabasename is OK". However as I continue developing my transformation something goes awry a... read more »
Published: Friday June 14th 1PM
Link: http://forums.pentaho.com/showthre...to-access-the-repository&goto=newpost
Description: I have setup a carte cluster using pdi 4.4 and mysql 5.5 following directions I found here: http://open-bi.blogspot.com/2009/11/...-serie-of.html then I followed the directions here to try to test the carte cluster: http://diethardsteiner.blogspot.com/...on-remote.html the issue I'm having is when I try to run the transformation I get this error: Quote: org.pentaho.di.core.exception.KettleException: org.pentaho.di.core.exception.KettleException: There was an error during transformation split org... read more »
Published: Friday June 14th 12PM
Link: http://forums.pentaho.com/showthre...-metadata-from-java-code&goto=newpost
Description: Is there a way to change connection metadata db server address, user, password etc. from java code I have tried something like that, but it didn't worked for me. Code: ... SharedObjects so = new SharedObjects ; for SharedObjectInterface soi : so.getObjectsMap .values if soi instanceof DatabaseMeta DatabaseMeta dm = D... read more »
Published: Friday June 14th 10AM
Link: http://forums.pentaho.com/showthre...-if-SQL-condition-is-met&goto=newpost
Description: How can I email if NULL rows are returned I have a transformation using MERGE ROWS DIFF / SYNC AFTER MERGE to reconcile data and, in this case, all NEW records will be added, but then I need to go back and for now manually update a column associated with the addition. This column will be NULL until someone updates it. So I'm trying to build a transformation or job that will only email when these null values are present essentially notifying me that a new record was added . Another somewhat logic... read more »
Published: Friday June 14th 9AM
Link: http://forums.pentaho.com/showthre...g-webservices-in-pentaho&goto=newpost
Description: Hi gurus, I am new to pentaho. Currently we have requirement in our project to call webservices and publish the results to oracle table. Below is the detail requirement: we are getting State,Zipcode details as csv format from source. Now we need to populate the longitude, latitude details using webservices corresponding to that state, city and store it in table. I tried to understand the existing transformation in sample folder but is giving me error. This is urgent requirement. Please help. Tha... read more »
Published: Friday June 14th 4AM
Link: http://forums.pentaho.com/showthre...-Date-conversion-and-BST&goto=newpost
Description: Hello, I'm running PDI CE v4.4 and have used a select values step to convert a field to a date using the mask yyyy-MM-dd HH:mm:ss.SSS. However PDI is rejected all dates between 2013-03-31 01:00 and 2013-03-31 02:00 as this the British Summer Time switch over so technically the date does not exists. Is there any way to turn off this as I'm processing data that does not originate from the UK and not all UK servers automatically switch with time change as this is delayed to avoid issues with the ov... read more »
Published: Thursday June 13th 12PM
Link: http://forums.pentaho.com/showthre...a-validation-please-help&goto=newpost
Description: Hello all I'm a new/jr DBA and I am working on a quick project that I'm having difficulty with. I want to add a step in some of our existing transformations to validate that the input dates are valid and in range e.g. 07/25/2009 is fine but 07/25/2100 is not . I was looking around on the 'net and found that I can use Regex with the Data Validation step for this aspect so I created the following expression for dates between 1900 and 2099 : ^ 0 13578 1 02 - / . 0-2 0-9 3 01 0 469 11 - / . 0-2 0-9 ... read more »
Published: Thursday June 13th 8AM
Link: http://forums.pentaho.com/showthre...on-pan-kitchen-and-carte&goto=newpost
Description: Hi, Each time when I run Spoon, Pan, Kitchen or Carte I get this error: Unable to load Hadoop Configuration from "file:///home/manuelg/www/kettle/plugins/pentaho-big-data-plugin/hadoop-configurations/mapr". For more information enable debug logging. I am using Ubuntu 13.04. Anyway Spoon can start and make transformations and jobs, but Carte is not working for me. Thank you in advance. read more »
Published: Thursday June 13th 4AM
Link: http://forums.pentaho.com/showthre...r-java -in-the-kettle4-4&goto=newpost
Description: where is the Java API Examples TransBuilder.java in the kettle4.4 thanks read more »
Published: Thursday June 13th 3AM
Link: http://forums.pentaho.com/showthre...-metadata-from-file-path&goto=newpost
Description: Hi, i am using file path. how to split column header from filename can i use java User Defined Java Class step to get it from file path metadata_injection.zip Any idea Thanks, Raju Attached Files metadata_injection.zip 5.0 KB read more »
Published: Wednesday June 12th 11PM
Link: http://forums.pentaho.com/showthre...144224-I-O-Buffer-Memory&goto=newpost
Description: Hi, I have clarification, If I run two separate flows into two different text files in the same transformation. How the execution will happen All I want to know is, Table I/p1 ----> Text file o/p1 Table I/p2 ----> Text file o/p2 When above transformation runs, whether the text file 2 will wait till text file 1 write finished , since it is using the same buffer memory Thoughts... If so, how to make it run in parallel i.e.. loading happens at the same time. read more »
Published: Wednesday June 12th 4PM
Link: http://forums.pentaho.com/showthre...fic-JavaScript-functions&goto=newpost
Description: http://type-exit.org/adventures-with...entaho-kettle/ This blog post states the existence of for example a function called 'createRowCopy'. But I can't find any offical documentation on this function. I also cannot find it in the list provided by the JavaScript Value step: Clipboard03.jpg Is there somewhere an official documentation on all available JavaScript functions specific to Kettle Thanks Raffael Attached Images Clipboard03.jpg 27.7 KB read more »
Published: Wednesday June 12th 4PM
Link: http://forums.pentaho.com/showthre...iable-quot-mean-the-same&goto=newpost
Description: The usage of the terms " and " confuses me. Are they synonyms or is there a difference in Kettle Regards Raffael read more »
Published: Wednesday June 12th 1PM
Link: http://forums.pentaho.com/showthre...with-the-Google-MAPS-API&goto=newpost
Description: Hello, I have to add standard locality/country/etc information derived from an address or lat/long. data in a database table. As far as I see I cannot use the appropriate Google JavaScript Library with the Script-Module, as it won't work there Javascript error: ReferenceError: " is not defined, after loading https://maps.googleapis.com/maps/api/js sensor=false An alternative would be to query the Server via the HTTP-Client, and parse it with the JSON module, but right now I most probably fa... read more »
Published: Wednesday June 12th 11AM
Link: http://forums.pentaho.com/showthre...ecuting-a-job-with-Carte&goto=newpost
Description: Hi, I have a strange error when i'm trying to execute a remote job on a slave server with Carte : ERROR executing query in part OQ Set values offending row : id1 Integer Error setting value #1 id1 Integer on prepared statement Integer com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operati ons allowed after statement closed. No operations allowed after statement closed. I work whith the version 4.2.1 -stable. Does anyone have encountered this problem I send my complete l... read more »
Published: Wednesday June 12th 11AM
Link: http://forums.pentaho.com/showthre...-O-error-Connection-quot&goto=newpost
Description: Hi I have a very simple job: Clipboard02.jpg The Logging panel reveals the following error: Code: 2013/06/12 17:05:46 - Spoon - Starting job... 2013/06/12 17:05:46 - test - Start of job execution 2013/06/12 17:05:46 - test - Starting entry HTTP 2013/06/12 17:05:46 - HTTP - Start of HTTP job entry. 2013/06/12 17:05:46 - HTTP - Connecting to URL: http://epp.eurostat.ec.europa.eu/NavTree_prod/everybody/BulkDownloadListing file=data/ei_isin_m.sdmx.zip 2013/06/12 17:05:46 - HTTP - ERROR version 4.4.0... read more »
Published: Wednesday June 12th 11AM
Link: http://forums.pentaho.com/showthre...lizing-row-to-byte-array&goto=newpost
Description: I was having some troubles with the SCD step today. My data is in an Oracle DB, all options set correctly using a sequence for the technical key . When I run for the first time the SCD, it caused the following error : Code: 2013/06/12 16:00:37 - Dimension Lookup / Update.0 - Changing the type of the technical key from TYPE_BIGNUMBER to an TYPE_INTEGER 2013/06/12 16:00:37 - Dimension Lookup / Update.0 - lookup row : 312079 , 2013/02/12 13:49:28.000 , 2013/02/12 13:49:28.000 2013/06/12 16:00:37 - ... read more »
Published: Wednesday June 12th 10AM
Link: http://forums.pentaho.com/showthre...Cross-Platform-Variables&goto=newpost
Description: Hi, does pentaho have an implementation or syntax that supports cross-platform environmental variables i.e. If a transformation is created in Windows, the user would use something like " foo /file.txt". However, if they then took the generated XML file and tried running it in Pan on a Linux system, this would obviously be a bad path. Is there a way to specify a variable so pentaho will instead perform a something like a System.getenv " instead We could build a workaround to perfor... read more »
Published: Wednesday June 12th 6AM
Link: http://forums.pentaho.com/showthre...on-within-a-formula-step&goto=newpost
Description: Be used to SQL CASE expressions, I do not find the IF very easy to use. The following expression: XTYPE / IF YPUB =0;1; YPUB generates : "ERROR : Parse Exception : Parsing error in formula : null " for whatever reason. Is there an alternative I have seen an item on adding CASE to Kettle version 5, but have no idea whether this will be in the next release.. read more »
Published: Wednesday June 12th 5AM
Link: http://forums.pentaho.com/showthre...-Pentaho-with-Infobright&goto=newpost
Description: Hi All, I am a non-technical user of Pentaho. I am trying to connect Pentaho Data integration to Ms Access database using an ODBC connection. However, everytime it gives me the following error: Error connecting to database Test1 : org.pentaho.di.core.exception.KettleDatabaseException: Error occured while trying to connect to the database Error connecting to database: using class sun.jdbc.odbc.JdbcOdbcDriver Microsoft ODBC Driver Manager The specified DSN contains an architecture mismatch between... read more »
Published: Tuesday June 11th 8PM
Link: http://forums.pentaho.com/showthre...2-inconsistent-behaviour&goto=newpost
Description: We have been using Kettle 3.2. We have few issues encountered while using this tool. 1. We have given "Split every 50000 rows" fora text file output but the way the files get split is inconsistent. 1st file has 49999 records and all subsequent files have 50000 records. Occasionally files get split up exceeding 50000 records. 2. All CSV files that we create as output has a appended 0 to the very first file. Ideally file count should start from 1. 3. We have a requirement to have headers... read more »
Published: Tuesday June 11th 8PM
Link: http://forums.pentaho.com/showthre...55-Calculated-Parameters&goto=newpost
Description: Hi All, I have an insert update transformation that queries my main DB that looks similar to this. select fields from table where field1 > ' parameter1 ' In my transformation's settings I have a the parameter1 there. Currently, when I move the data into my reporting db I manually input the number in the value when running the job. Is there a way for me to have a calculated parameter in place that gets the max value from my reporting table and input the value into " Any help is appreciate... read more »
Published: Tuesday June 11th 4PM
Link: http://forums.pentaho.com/showthre...several-files-in-one-job&goto=newpost
Description: Hi I run a job with a transformation that spits out rows and the field containing the URL of the to be downloaded file is named ". The transformation sends those rows to an HTTP step that takes the URLs row-by-row from the "-field. Clipboard02.jpg And that works fine - I can see the files being downloaded - but I just can't find a way to store all those downloaded files in some folder. In the end I am always left with the last file listed. Please have a look at my simplified example jo... read more »
Published: Tuesday June 11th 10AM
Link: http://forums.pentaho.com/showthre...-plugin-in-mongodb-input&goto=newpost
Description: Hello, I have a mongodb input in which I have to say load from previous step. Currently we are doing this by a separate transformation.Since this prev step has to access a different database I cannot use it as a variable in mongodb query. Is there any java plugin or script I can write to get this done within mongodb input Thanks in advance. Deepthi read more »
Published: Tuesday June 11th 4AM
Link: http://forums.pentaho.com/showthre...ile-names-from-prev-step&goto=newpost
Description: Hi All, I know this has been discussed before but I still couldn't figure out and how to make it work I don't understand what this message really means " Please specify at least one text file sample in the file list. When reading file names from previous steps, this file will not be used during processing." 1. Where should this sample text file be specified 2. What should it contain How to get a file name from previous step I have attached Screenshot of the design and the "Text fi... read more »
Published: Tuesday June 11th 4AM
Link: http://forums.pentaho.com/showthre...-Mail-via-SMTP-GMAIL-COM&goto=newpost
Description: hi all Trying to send email from myadress gmail.com to myadress mydomain.ch using Mail Entry in Job. I read almost all threads regarding my same problem with sending emails using smtp.gmail.com. i did what were suggested: Setting in email_config, also tried both SSL with 25/465 and TLS with 587. i did use my gmail account. no way, it still is not solved. If to use SSL with 25 or 465 it shows an error with Socket connection. If to use TLS with 587 it shows an error with AuthenticationFail. I acti... read more »
Published: Tuesday June 11th 2AM
Link: http://forums.pentaho.com/showthre...based-on-given-condition&goto=newpost
Description: userID--- ansID --- objid------- testype ---------------- Date--------------- attempt 1 --- ---- 1234 ------ 1 ------ ConceptTest ------- 1/12/2013 12:12:01------- 1 1 ------- 123445--- - 1 ------ ConceptTest-------- 1/12/2013 12:12:01 ------ 1 1---- --- 123445 -----1 ------ ConceptTest ------- 1/12/2013 12:12:02------- 2 1------- 123445 ----- 2 ------ ConceptTest-------- 1/12/2013 12:12:02------- 1 2 ------ 123445------ 2------ ConceptTest ---------1/12/2013 12:12:02------- 1 2 -------2456-----... read more »
Published: Monday June 10th 8PM
Link: http://forums.pentaho.com/showthre...-in-original-Excel-Input&goto=newpost
Description: Hi, I am new to kettle but making great progress : I have a transformation written that successfully takes a spreadsheet of data and updates corresponding rows in a MySQL table. Now I find that part of the updated data is deleted rows that are no longer necessary. Is there a way to process this automatically I know I could create an excel sheet of record IDs that need to be deleted and get rid of them that way, but I'd rather not have to manually figure out which ones those are. Thanks read more »
Published: Monday June 10th 4PM
Link: http://forums.pentaho.com/showthre...les-in-table-output-step&goto=newpost
Description: Hi, Matt has posted a video here http://www.youtube.com/watch feature...&v=EjzgzOanq1o which outlines how to use the metadata injector to get data into a table. I'm trying to do almost exactly what he's doing in the video, and I've got the metadata injector working, but I can't work out how he uses variables in the table output step. I'm guessing that I'm being really thick, but without any set variables steps and no obvious way to use variables in the table output step I'm stuck. Any ideas ... read more »
Published: Monday June 10th 10AM
Link: http://forums.pentaho.com/showthre...-file-into-single-record&goto=newpost
Description: My input file contains records which span multiple lines and record begins with a line break then eight digits then a '1'. I am a newbie but I believe what I want is a "text file input" that has a filetype of CSV where the separator is a regular expression matching a this pattern but can't get it to work. Can anyone point me in the right direction TIA. read more »
Published: Monday June 10th 9AM
Link: http://forums.pentaho.com/showthre...ve-warnings-from-minimal&goto=newpost
Description: Simple, is there any way to remove warnings from minimal logging level read more »
Published: Monday June 10th 1AM
Link: http://forums.pentaho.com/showthre...parameter-in-a-transform&goto=newpost
Description: Hi , I want to pass max numeric field and min numeric field to a parameter defined in the job through a transform to do calculation. how can i do this so that the max and min values are available to all the transforms in the job. read more »
Published: Monday June 10th 12AM
Link: http://forums.pentaho.com/showthre...om-Target-before-loading&goto=newpost
Description: For various reasons, I have concluded that I need in this particular case to do things in this order: 1. Extract data in extract transformation from source between date_a and date_b. 2. In Load transformation, first delete data from target for data between date_a and date_b. 3. In Load transformation, do an insert of all data extracted from 1 . So basically want to do like if I checked the "truncate table" option on the target table, except do a delete based on a date range which is st... read more »
Published: Sunday June 9th 2PM
Link: http://forums.pentaho.com/showthre...44022-how-to-join-2-rows&goto=newpost
Description: Hi. I have got 2 Access files. File A contains one table: Name Surname Age Sex Peter XXX YYY ZZZ File B contains one table: Height Weight Eye color Hair color AAA CCC DDD FFF I need to join these 2 tables into the one table. Name Surname Age Sex Height Weight Eye color Hair COlor Peter XXX YYY ZZZ AAA CCC DDD FFF How to do it Thanks a lot read more »
Published: Saturday June 8th 5AM
Link: http://forums.pentaho.com/showthre...tion-in-Java-application&goto=newpost
Description: i use the java api to launching a ktr, and the ktr:" use the Hadoop File Output" this is the java code: public static void runTrans String filename throws Exception KettleEnvironment.init ; TransMeta transMeta = new TransMeta filename ; Trans trans = new Trans transMeta ; trans.prepareExecution null ; trans.startThreads ; trans.waitUntilFinished ; if trans.getErrors =0 System.out.println " ; it is good when i use the apache hadoop but when i use the cloudera, i always can't connec... read more »
Published: Saturday June 8th 3AM
Link: http://forums.pentaho.com/showthre...-execute-a-job-on-demand&goto=newpost
Description: Hi all, i need to execute a job not on a schedule basis, but on demand. After it has finished, it should restart again waiting for the next execution request. Usually i'll have several exec requests in some days of the month, then no more requests for weeks. Which is the best way to do that Now I'm running daily two 'master jobs' at 2:00 AM and at 2:00 AM; I'd like to avoid to schedule a job every 30', during day and night; it would be useless and CPU consuming... Thank you for any suggestion. A... read more »
Published: Saturday June 8th 3AM
Link: http://forums.pentaho.com/showthre...inputs-in-calculato-step&goto=newpost
Description: Hi I have a column current balance coming from table, and max, min of same current balance column coming from a file/sql query. For every current balance row i want to apply the formula current balance - min / max -min . I used the calculator step but it is giving an error unable to find argument field. can anyone help Is it because calculator doesn't accepts multiple inputs read more »
Published: Saturday June 8th 1AM
Link: http://forums.pentaho.com/showthre...how-to-use-generate-Rows&goto=newpost
Description: i am new to pentaho, i have to create exercise like this using Spoon 1.Date column values starts from 01-01-2005 to 31-12-2024 around 24 years dates 2.Year : pick year from the date column 2005 3.Month: pick month of date column 1 4.dayofyear: day of date column 1 to 365/366 5.dayofmonth: 1 to 30/31 6.weekofyear: 1 to 54 7.quarter 1 to 4means month is between 1-3 is 1st quqter,4-6 is 2st quqter 8.DATE_FROM: 01-01-1900 constant for all rows 9.date_to: 01-01-2100 constant for all rows 11.verrsion:... read more »
Published: Friday June 7th 7PM
Link: http://forums.pentaho.com/showthre...enplum-load-from-windows&goto=newpost
Description: I am trying to do a greenplum data load from windows and I get an error: Error while executing 'C: Program Files x86 Greenplum greenplum-loaders-4.2.1.0-build-2 bin gpload.py -f c: temp control0.cfg' I have installed the GP loader for windows, but it doesn't seem to work. I see it's a python program. Is there some other setup / configuration I need to do read more »
Published: Friday June 7th 10AM
Link: http://forums.pentaho.com/showthre...nnect-to-JNDI-Datasource&goto=newpost
Description: Hi guys, I experience a strange problem when doing the following: Using CDA from inside the PUC we send the Query to a KTR file which should load some data. However, the connection to the database cannot be established, causing such error messages: Code: INFO 07-06 16:54:41,225 - article_order - Dispatching started for transformation article_order ERROR 07-06 16:54:41,266 - Database lookup - An error cause this step to stop: org.pentaho.di.core.exception.KettleDatabaseException: Error occu... read more »
Published: Friday June 7th 9AM
Link: http://forums.pentaho.com/showthre...entation-from-repository&goto=newpost
Description: Hi everyone, excuse me in advance if my request has already been answered, but I haven't found it surfing the forum :- I've tried to use the kettle cookbook project http://code.google.com/p/kettle-cookbook to automatically document my ETL projects, but I haven't found a way to do it for a DB-repository stored project. Do you know a simple way to do it with kettle-cookbook or other tools Thanks in advance, Vic read more »
Published: Friday June 7th 9AM
Link: http://forums.pentaho.com/showthre...with-limit-order-by-sort&goto=newpost
Description: Hi guys, I needed to generate some reports based on mongodb data but MongoDB Input step did't have the functionality I wanted so I did some enhancements and want to share it. I used pentaho-mongodb-plugin as a base that's why my extension is called pentaho-mongodb-plugin-ext, feel free to use it New functions I added to the plugin: - order by / sort query - limit results - query parameters based on previous row First two are very simple, but query parameters need some explanation. You have to pu... read more »
Published: Friday June 7th 8AM
Link: http://forums.pentaho.com/showthre...ot-Regex-evaluation-quot&goto=newpost
Description: Hi I have a simple file to parse, and I am trying to do it with kettle rather than in php The structure of the file is something like that: Code: 12498278 NAME LASTNAME AFF.... read more »
Published: Thursday June 6th 4PM
Link: http://forums.pentaho.com/showthre...-command-line-Kitchen-sh&goto=newpost
Description: i have community Edition 4.4 and i have developed a job using spoon. If i want to execute the job on the linux server using kitchen.sh, what are the steps i need to take Also if you could help with the command line syntax for kitchen.sh, that will be very helpful. read more »
Published: Thursday June 6th 4PM
Link: http://forums.pentaho.com/showthre...mation-or-job-invokation&goto=newpost
Description: Hi, I am creating a reusable transformation that will implement checkpoint for a transformation or job by creation of touch files. This reusable transformation would be called by any job. The plan is use UDJC user defined java class to invoke a job or transformation based on the argument that is given to this reusuable component. The problem 1 i am new to udjc and ... The transformation or job invoked by UDJC is unable to access the value of the variables the scope is at " level which are s... read more »
Published: Thursday June 6th 1PM
Link: http://forums.pentaho.com/showthre...I-Analyzer-Export-to-PDF&goto=newpost
Description: Hi, I have two issues when using the PDI Analyzer when I export to PDF either the Table Format or the Chart. Neither display on the screen only what appears to be a broken link. For the Table Format when I cut and paste the properties URL on a browser, the PDF is there and renders on the browser ok. For the Chart when I cut & paste the properties URL on a browser, the message 'Failed to Load PDF document' renders on the browser. thank you for your help, Carlos... PDI_Analyzer_PDF.jpg Attache... read more »
Published: Thursday June 6th 9AM
Link: http://forums.pentaho.com/showthre...ead-of-Internet-Explorer&goto=newpost
Description: On the Welcome tab in Spoon, whenever I click a link to view online documentation, it opens Internet Explorer to view the web page, even though Chrome is my default browser. Is there any way to configure Spoon to open Chrome instead I use PDI 4.4.0 CE on Windows 7 64-bit , but I've seen this behavior in all versions of Spoon on all versions of Windows that I have used. read more »
Published: Thursday June 6th 9AM
Link: http://forums.pentaho.com/showthre...55-How-custom-spoon-menu&goto=newpost
Description: How custom spoon menu read more »
Published: Thursday June 6th 9AM
Link: http://forums.pentaho.com/showthre...rise-Repository-Question&goto=newpost
Description: I feel stupid for even ASKING this question, but my googling does not find what I am looking for. I'm using PDI 4.4.1, with an Enterprise Repository connected to DISERVER, default port 908 Anyway, the repo works great. It keeps a history of all of my changes, and I can go back to previous versions any time I want. ALl of the features work perfectly. My question is: "where is the actual data of that repository stored is it in a database I don't know about Is it on the server's file system in... read more »
Published: Thursday June 6th 8AM
Link: http://forums.pentaho.com/showthre...-quot-group-by-quot-step&goto=newpost
Description: Hi I am currently setting up a CSV-importing involving the aggregation of a field typed Number. But the aggregated sum only serves a single digit behind the floating point. I need at least two. The following example is a simplified example illustrating the issue. the transformation: trafo.png I choose Number using a precision of 3 figures behind the comma. data_grid_settings.jpg data_grid_preview.png group_by_settings.png But the result is rounded to 1 digit behind the comma. group_by_preview.pn... read more »
Published: Wednesday June 5th 4PM
Link: http://forums.pentaho.com/showthre...le-Plugin-for-Quickbooks&goto=newpost
Description: Does anyone know of a plugin for Kettle to connect with Quickbooks thank you, Carlos... read more »
Published: Wednesday June 5th 4PM
Link: http://forums.pentaho.com/showthre...c-Salesforce-Insert-Help&goto=newpost
Description: Hello, I am having a hard time getting Kettle to allow me to insert records into a custom SF object we have called ". I am testing in our Sandbox and I can get the field mappings to auto-match on the module so I know it's talking to SF but when I run the transform the job just fails with the error message below. Can anyone look over this error message and attached photo of my module config and maybe shed some light on what is going on Quote: 2013/06/05 15:04:21 - Spoon - Transformation open... read more »
Published: Wednesday June 5th 3PM
Link: http://forums.pentaho.com/showthre...he-middle-of-kitchen-job&goto=newpost
Description: Quick and simple - is it doable I thought maybe a simple "Execute a process" to run "cmd /c pause" would work, so the user would have the option to ctrl+C out of the .bat running kitchen job, but no deal. The only other option I'm thinking so far would be to break the job in two, and use the .bat file to do that - calling the second part if the user decides to continue... read more »
Published: Wednesday June 5th 1PM
Link: http://forums.pentaho.com/showthre...43807-Export-to-dbf-file&goto=newpost
Description: Hello, Does anyone know if it is possible to export to a .dbf file in PDI Thanks Deborah read more »
Published: Wednesday June 5th 1PM
Link: http://forums.pentaho.com/showthre...tep-and-VIES-web-service&goto=newpost
Description: Hi. I'm trying to use the Web services lookup step with the VIES VAT number validation webservice provided by the European Comission http://ec.europa.eu/taxation_customs...atService.wsdl , and I always get the followin error: Code: 2013/06/05 18:13:51 - Web services lookup.0 - Using SOAP Action string "urn:ec.europa.eu:taxud:vies:services:checkVat/checkVatApprox" in the request header. 2013/06/05 18:13:51 - Web services lookup.0 - ERROR version 4.4.0-stable, build 17588 from 2012-11-21... read more »
Published: Wednesday June 5th 12PM
Link: http://forums.pentaho.com/showthread.php 143803-Flag&goto=newpost
Description: Hi, How to identify if the row is deleted in the source table when we are implementing type 2 can anyone explain me My source src_emp example is : empno,ename,sal 1,aaaa,100 2,bbbb,200 3,cccc,300 3,cccc,400 My target trg_emp table should look like empkey,empno,ename,sal,version,active_flag,deleted_flag 1, 1, aaaa, 100,1, Y, N 2, 2, bbbb, 200,1, Y, N 3, 3, cccc, 300,1, N, N 4, 3, cccc, 400,2, Y, N After doing this i will delete one row in source table which is sal like 300 now the deleted_flag in... read more »
Published: Wednesday June 5th 10AM
Link: http://forums.pentaho.com/showthre...to-find-set-PATH-of-USER&goto=newpost
Description: Hi all I am now confronting a problem with PATH. Pentaho is downloaded in folder Program Files. But there are creating/deleting folders/files procedures in the job when it gets run. An ordinary user cannot run the job made because of lack of administration-rights. Please suggest, how can i set it so, that i creates/deletes folders/files not directly in Pentaho which is under Program Files, but in User's Documents Any help appreciated, Thank you in advance read more »
Published: Wednesday June 5th 10AM
Link: http://forums.pentaho.com/showthre...eb-app-classpath-problem&goto=newpost
Description: I'm designing a web-based interface for launching Kettle transformations. The web app allows the user to choose information stored in a database, the Kettle transformation, and the output file name. They then can launch the transform from the web page. I don't want the user to use Spoon to drive the process. All of this works fine. For simple transforms, e.g. read from a database and produce a .csv file, it works fine. When the transform is to produce an Excel file the transform fails with a &qu... read more »
Published: Wednesday June 5th 8AM
Link: http://forums.pentaho.com/showthre...uest-can-not-be-repeated&goto=newpost
Description: hi, I am trying to access a web service via the HTTP Post step and get the following error: Unbuffered entity enclosing request can not be repeated. I have tested the Web Service using soapUi. It works correctly. What means this error What can i do to circumvent it I am using PDI 4.4.0-stable. Thanks for any help. read more »
Published: Wednesday June 5th 6AM
Link: http://forums.pentaho.com/showthre...778-AWS-EMR-JOB-executor&goto=newpost
Description: Hi, This is suresh, working on big data analytics. I want to execute a AWS Hive / AWS EMR job from pentaho PDI spoon . I'm using PDI stable release 4.4.0. My data location in AWS s3 buckets. When I want to execute my AWS EMR job executor I'm getting "Stream closed" error every time. Can anyone help me resolve this issue Appreciated your help. Thanks Suresh.K read more »
Published: Wednesday June 5th 5AM
Link: http://forums.pentaho.com/showthre...lse-Javascript-statement&goto=newpost
Description: Hi All, I have two columns " and ". I want to create a new column " and Copy values from " but if " is empty, I want to copy values from ". I tried this with JS and it works on a normal editor but on Pentaho, I am not getting results as expected. Here is my JS snippet: var phone = strCellphone ; if strCellphone.length phone = strPhone; I have also tried various ways of checking null, empty like this one -> if strCellphone.length strCellphone === ' ' phone = strPh... read more »
Published: Wednesday June 5th 2AM
Link: http://forums.pentaho.com/showthre...Problems-with-parameters&goto=newpost
Description: Hi, i am using batch file in windows. first of all, i have main job and i want to place in batch file. its working perfectly i have parameters in main job so, Following was the command line I used. batchfile.png Errors with parameters, Any advice :confused: more research using parameters with kitchen http://wiki.pentaho.com/display/EAI/Named+Parameters thanks Vicky PDI 4.4.0-stable windows 7 Attached Images batchfile.png 5.7 KB read more »
Published: Tuesday June 4th 7PM
Link: http://forums.pentaho.com/showthre...iling-to-get-initialized&goto=newpost
Description: Hi, I have resusable transformation which uses a udjc user defined java class to invoke both transformation or job based on the parameter that is passed to this reusable transformation. I am getting "Error initializing UserDefinedJavaClass:" method for this udjc. So i am able to execute the transformation or job that is passed on to this reusable transformation. But if create a standalone transoframation with same udjc and passed the hardcoded value of transformation/job name then it e... read more »
Published: Tuesday June 4th 5PM
Link: http://forums.pentaho.com/showthre...-Metadata-injector-issue&goto=newpost
Description: I'm trying to run the metadata injector step on some test data and I'm getting an undefined field error. Code: 2013/06/04 22:30:24 - Text file output.0 - Starting to run... 2013/06/04 22:30:24 - CSV file input.0 - Header row skipped in file '/Users/Shared/march_2013_expenditure.csv' 2013/06/04 22:30:24 - Select values.0 - ERROR version 4.3.0-stable, build 16786 from 2012-04-24 14.11.32 by buildguy : Unexpected error 2013/06/04 22:30:24 - Select values.0 - ERROR version 4.3.0-stable, build 16786 ... read more »
Published: Tuesday June 4th 5PM
Link: http://forums.pentaho.com/showthre...g-Variables-and-Wildcard&goto=newpost
Description: Hello, I searched the forum and did not find a post related to this topic. I am executing a Job with parameters. I would like to reference the Parameters defined in the job in a transformation executed by the job. The Transformation performs a "Text File Input" step and in this step I am attempting to obtain the Directory path as a variable and read all files that begin with a specific High Level Qualifier. I have been successful on using variables with the "Accept filenames from ... read more »
Published: Tuesday June 4th 3AM
Link: http://forums.pentaho.com/showthre...assing-all-the-variables&goto=newpost
Description: Hi, How do I pass all the variables with scope as " be made available to the transformation /job executed using user defined java class We can do setVariable to get for each variable. But do we have an approach/method by which by default all the variables will be passed to the transformation or job executed by the java class it seems that variables set in previous steps of the same job run is not available to the transformation executed by the java class. Regards, Pramod. read more »
Published: Monday June 3rd 9PM
Link: http://forums.pentaho.com/showthre...t-variables-in-sql-query&goto=newpost
Description: hi all, I use "select country from table",I get countries "US,UK", then I want to use "select from table1 where country = ", as countries , what can I do . read more »
Published: Monday June 3rd 5PM
Link: http://forums.pentaho.com/showthre...-steps-using-pentaho-api&goto=newpost
Description: Is there a way to auto position created steps using pentaho api i.e: instead of doing step.setLocation 350, 100 is there a way to call something which will position all the steps in the "most optimal way" read more »
Published: Monday June 3rd 4PM
Link: http://forums.pentaho.com/showthre...box-time-dimension-table&goto=newpost
Description: I'm trying to create a time dimension table on my db to connect to my fact table with several time metrics. However, using my date field in the data and several date_format syntax to convert the time stamp I'm finding that I am missing certain hours in the day. Is there an out of the box transformation for PDI for time dimensions read more »
Published: Monday June 3rd 1PM
Link: http://forums.pentaho.com/showthre...ing-transformation-alone&goto=newpost
Description: I have a simple job that calls two transformations, passing result from one to the other. I cannot figure out has to run the 2nd transformation in Spoon, " the result row. First transformation calls "Get file names" to find a file, and then passes the filename, directory, and full path to the result stream using "Copy rows to result". The second transformation reads the result stream using "Get rows from previous result", then reads the file and transforms the ... read more »
Published: Monday June 3rd 10AM
Link: http://forums.pentaho.com/showthre...-Writer-formula-problems&goto=newpost
Description: So, new week, new problems needing help =p I'm playing now with formulas on Excel Writer output... but I can't seem to get it right. First few problems were kinda dumb, actually... MS in PT-BR uses ; instead of , to separate arguments inside functions, but that was easy to find out. Translation of functions from pt-br to en was also easy to find... but now I'm getting a strange message, but searching google for it is returning me almost only this source code. Formulas used: Code: VLOOKUP ",... read more »
Published: Monday June 3rd 8AM
Link: http://forums.pentaho.com/showthre...st-date-from-source-file&goto=newpost
Description: Hi, we have 1 input file as Date dd/MM/yyyy date_input.png i need latest date from stream date_canvas field Please help me Attached Images date_input.png 2.8 KB read more »
Published: Monday June 3rd 5AM
Link: http://forums.pentaho.com/showthre...Pentaho-Data-Integration&goto=newpost
Description: I'm using the step "REST Client" to call a web service that returns the initial data in json format. The number of the returned records is limited to 50. Code: ": ": 2324,": 47,": 50,": 1,": ": "https://rest.tld/business_object/ recordsPerPage=50&pageNum=2", ,": Therefore I have to read the nested property " within the json object to have access to the next 50 records. I tried to work with a XMLHttpRequest ... read more »
Published: Monday June 3rd 1AM
Link: http://forums.pentaho.com/showthre...tion-while-loading-class&goto=newpost
Description: Hello: I am getting this error most of the time when I run this job. It seems to work most often but not always from the Pentaho Designer, and never seems to work when I run the job from a batch file. Here is a sample of the log. The driver for the table input which is failing is net.sourceforge.jtds.jdbc.Driver, which is pointing to a SQL Server. Pentaho is version 4.2. Since it works sometimes obviously the variable is o.k and the class does exist. Code: INFO 02-06 22:35:49,717 - write_t... read more »
Published: Saturday June 1st 5PM
Link: http://forums.pentaho.com/showthre...ciated-in-setting-up-job&goto=newpost
Description: Hello, I am very new to Kettle and would like to ask for help in setting up a job/transformation with teh following capability: 1. Check Database table to see if any rows currently exists 2. If rows exists, move the data to a backup table and clear current table 3. Read excel file 4. Store excel file into table that was cleared 5. Done My problem has been with the parallel execution of the transformation. I have tried flow control but guess i am not doing correctly. What is the best way of perfo... read more »
Published: Saturday June 1st 11AM
Link: http://forums.pentaho.com/showthre...ODBC-connection-error s &goto=newpost
Description: Hi i know this is a common issue that it saves putting the 'mysql-connector-java-5.1.25-bin.jar' driver into 'C: Archivos de programa pentaho design-tools data-integration libext JDBC'. But in my case this doesn't solves it. I tried so many variants, put it on 'libext', 'lib'... always the error message was: Exception while loading class org.gjt.mm.mysql.Driver I think this error became of missing path or something... I tried too to make a new database connection v a ODBC, and this way was succe... read more »
Published: Friday May 31st 12PM
Link: http://forums.pentaho.com/showthre...on-error-on-Excel-Writer&goto=newpost
Description: I'm guessing Slawo will be the best to solve this one =p Whole transformation runs normal, without any problems at all... it ends on a sort rows, followed by Excel Writer. If I disable this final hop and try to preview on Sort Rows, I get an error without any messages. If I just run, final hop still disabled, no errors. If I enable the final hop and try to run, Excel Writer gives me this error: Code: Microsoft Excel Writer 2 4.0 - ERROR version 4.4.0-stable, build 17588 from 2012-11-21 16.02.21 ... read more »
Published: Friday May 31st 8AM
Link: http://forums.pentaho.com/showthre...mation-End-less-loop-err&goto=newpost
Description: Hi, We are implementing restartability from point of failure by creating touch files. But as these steps are repeating I thought of creating a common wrapper job which accepts job/transorfmation path name,job/transformation name as paramters and carrying out the if then else with the files. Assume that I have a master job J1 and it calls a child job J2 which has two child jobs J3 and J4 and I am calling J2,J3 and J4 using this wrapper job. But the problem is I am getting endless loop error when ... read more »
Published: Friday May 31st 5AM
Link: http://forums.pentaho.com/showthre...ery-in-after-filter-rows&goto=newpost
Description: Hi, In my diagram at a certain point, I have a filter rows. If the result is TRUE I would like to do a SELECT otherwise FALSE another kind of select. I did it with two table input objects. Actually, after the filter rows, both the two tableinput are executed may be because are initialized at the start. I've also tried with the SQL script but it seems to has the same behavior. How Can I do that Thanks read more »
Published: Thursday May 30th 4PM
Link: http://forums.pentaho.com/showthre...ort-is-generated-via-PDI&goto=newpost
Description: Hello, I have a PRD report .prpt , where i have applied a format like #,##0 for number fields, so that i have the thousand separator ','. When this report is published to console, i see that comma for large values. But when the same report is generated via PDI using the pentaho reporting output - accessing the prpt from the published location, there is no comma Why is that Here are the details of the problem : Number field in prpt file, with formatting applied like #,#0.00Preview this report in ... read more »