Infinium

@infiniuminc

Infinium is a professional and education services firm that specializes in delivering technology-enabled business solutions. Our expertise spans the business initiative lifecycle from opportunity identification to problem definition to solution delivery. Our focus is on extracting maximum return on information investments in business intelligence, information management and enterprise application integration. Our data management practice focuses on ensuring that the data generated by a business entity is appropriately managed to deliver actionable information to decision-makers.

266 posts

Posts

How to import an Excel workbook into SQL using SSIS

Courtesy to simple-talk.com

Prerequisite files:

SQL 2012 (Express with Advanced Services is recommended for full functionality)

http://www.microsoft.com/en-us/download/details.aspx?id=29062

1. We’ll create a simple workbook in Excel as an example that should looks like this:

and we’ll try and get it to look like this in SQL:

Save all changes in Excel then close Excel to avoid errors.

2. Open…

View On WordPress

ERROR: The query processor is unable to produce a plan because the index ‘INDEX_TABLE’ on table or view ‘Table’ is disabled.

REASON: We find that some disable the cluster index due to which issue occur. Clustered index physically sort & save data in pages. When clustered index is disable, DB engine is not able to access data although data is available with table. SCREENSHOT:

SOLUTION: 1. Go to Object explorer in SQL Server and locate your table in the database. 2. Expand the various folders available under the table by…

View On WordPress

When to use T-Sql versus SSIS| A Rough Guideline

Since there is functionality that can be performed by both technologies, there is always going to be some gray area. It is important to note, T-SQL and SSIS are complimentary. Many solutions will require the use of both technologies. SSIS is more generally more difficult to maintain, migrate and version as opposed to stored procedures. This inherent complexity can be resolved by a…

View On WordPress

Finding International Characters in a given field

drop table wrk_dq_international_char create table wrk_dq_international_char (GUID uniqueidentifier, Value nvarchar(255)) insert into wrk_dq_international_char select contactid, emailaddress1 from online_vehicle_exchange_mscrm.dbo.contact c --where c.emailaddress1 is not null -- and rtrim(ltrim(emailaddress1)) <> ''

create table wrk_dq_international_char (TableName varchar(200), ColumnName…

View On WordPress

How to link a parent report to a child report based on selected data in SSRS

In child report, set up the parameter condition where id=@parentkey — preferrably a primary key

In the child report, create a new dataset for the drop-down

select distinct parentkey, associated primary value from parenttable

Click report parameters Create parameter parentkey Make it correct dataype For available values select databseid For label values select primaryvalue field For defaulvalues…

View On WordPress

#report

How to set up DBMAIL in SQL Server

use master go sp_configure ‘show advanced options’,1 go reconfigure with override go sp_configure ‘Database Mail XPs’,1 –go –sp_configure ‘SQL Mail XPs’,0 go reconfigure go EXECUTE msdb.dbo.sysmail_add_account_sp @account_name = ‘EDW_SSIS’, @description = ‘Mail account for EDW’, @email_address = ‘[email protected]’, @display_name = ‘Enterprise DataWarehouse’, @username=’[email protected]’, @p…

View On WordPress

#mail

Infinium Training | Microsoft Data Solutions Delivery

Technology

Windows Server 2012

SQL Server 2012

T-SQL

SSIS

Data Quality Services

Master Data Services

Location

Perimeter or Alpharetta (To be Announced)

Classes

6 pm – 9 pm

November 17th

November 24th

December 1st

December 3rd

December 5th

December 8th

December 10th

December 12th

December 15th

Topics

Software Development Lifecycle

Application Lifecycle Management

Te…

View On WordPress

Infinium SQL Server Training Registration Form

CLASS SCHEDULE SQL Class – Sundays from 9am-5pm on November 16th, November 23rd and December 7th SSIS Class – M-W-F from 6pm-9pm on November 17th, November 24th, December 1st, December 3rd, December 5th, December 8th, December 10th, December 12th, and December 15th Name(required) Email(required) Phone Address(required) What classes would you like to enroll?(required) SQL (300$) SSIS (300$) Both…

View On WordPress

Heartbeats

The NameNode and the DataNode are managed by heartbeats. It provides the NameNode confirmation about the availability of the blocks and the replica of the DataNodes. Heartbeat also provides the information about the total storage capacity, storage in use and the number of data transfer. If the NameNode does not receive a heartbeat from a DataNode within 10 minutes, it considers that the DataNode…

View On WordPress

#DataNode #Heartbeat #NameNode

Important HDFS Components

The communication and management between a NameNode and DataNode is the most critical component within the HDFS architecture. This aspect is implemented as a protocol of handshakes and system IDs. A namespace ID is assigned to the file system on the NameNode. This ID is stored on all the nodes across the cluster. Similarly, the DataNodes are assigned unique storage ID on the creation and…

View On WordPress

#DataNode #NameNode #Protocol of Handshake

Installing Hadoop in Easy Steps

Hadoop is meant for a multitude of distributed machines processing data simultaneously. For development purposes, this is obviously impractical. A pseudo-distributed virtual environment on your desktop is alternative for learning install, implement and utilize the power of Hadoop.

To install Hadoop, you will need the following: A modern computer. At the time of writing, the following specs…

View On WordPress

#hadoop #install #linux #ubuntu #virtual #virtualbox

HDFS Client

The client is a layer of interface that is used by programs to access data stored within HDFS. The client first contacts the NameNode to get the location of the data blocks and once these data blocks are returned to clients, it reads block contents from the closest DataNodes. When writing, the client request the NameNode to provide to DataNodes where the data is written. When the block is…

View On WordPress

#Client #DataNode #NameNode

HDFS Block Allocation

HDFS exposes a file system namespace and allows user data to be stored within the HDFS files. The namespace is represented by inodes, which represent files and records attributes like permission,changes and access time and disk space qouta. An HDFS files consists of number of blocks and the replicas of the blocks are stored on different DataNodes.

View On WordPress

#Block Allocation

HDFS Architecture Building Blocks

Namenode

A single master server that manages file system namespace and manages access to files by clients. NameNode manages operations like opening, closing, renaming files and directories and mapping blocks to DataNodes.

DataNodes

Slaves that manage data and storage. An HDFS cluster can have thousands of clients per cluster. Each node can execute multiple tasks simultaneously. DataNodes are…

View On WordPress

#architecture #big data #nodes

Hadoop Timeline

2002 – Hadoop was started an open source search engine project called Nutch by Mike Cafarella and Doug Cutting.

2004 – Cafarella and Cutting developed an excellent crawler engine but hit a road block with the scalability of the search engine.

2004 – Google announced the availability of Google File System (GFS) and MapReduce papers to open-source community.

2004 – The Nutch team (Cafarella and…

View On WordPress

#hadoop

Tableau

Tableau produces interactive data visualization products focused on business intelligence and has been adding a lot of support for online publishing and content creations. Tableau embedded graph has become very popular with news organizations on the Web. Tableau has the capability of creating some map styles that cannot be produced by Google products.

To learn more about Tableau click here.

View On WordPress

Fusion Tables

Fusion Tables is a powerful tool that is used for gathering, visualizing and sharing data table. Fusion Tables stores large amount of data in spreadsheet-like tables and provides tools to process and visualize the information particularly turning geographical data into compelling maps.

View On WordPress

Infinium @infiniuminc - Tumblr Blog | Tumgag

Trending Blogs

Recently Viewed Blogs

Infinium