Tips to Learn Easier and Faster

1) Visualization

The idea of Visualization here is that you want to put abstract information into a picture. If you are struggling to understand a concept, visualization is a good technique to start with.

2) Interlinking

Take two ideas and ask yourself how they relate. They can be ideas within a specific field (short roads) or between two completely different fields (freeways). By doing this you create a roadmap for traveling between information in your brain. I suggest reading my article on holistic learning if you want to find out more.

3) Diagram

Draw it out. I love using diagrams for sorting large pieces of information. When I used to write computer programs fairly heavily, my desktop would have pieces of paper with hastily scratched diagrams. I consider creating a diagram to be the upgraded version of visualization.

4) Self-Test

Give yourself a test. Testing is a good way to see if you know what your doing, so try it out.

5) Learn in Multiple Ways

Don’t focus on learning in an only one way.Always Focus on learning in more than one way.Instead of just listening to a podcast, which involves auditory learning, find a way to rehearse the information both verbally and visually. This might involve describing what you learned to a friend, taking notes or drawing a mind map. By learning in more than one way, you’re further cementing the knowledge in your mind.

6) Teach What You’ve Learned to Another Person

Teaching can improve your learning. Educators have long noted that one of the best ways to learn something is to teach it to someone else. You can share your newly learned skills and knowledge with friends or others.

7) Gain Practical Experience

For many of us, learning typically involves reading textbooks, attending lectures or doing research in the library or on the Web. While seeing information and then writing it down is important, actually putting new knowledge and skills into practice can be one of the best ways to improve learning. If you are trying to acquire a new skill or ability, focus on gaining practical experience. If it is a sport or athletic skill, perform the activity on a regular basis. If you are learning a new language, practice speaking with another person and surround yourself with immerse experiences.

Advertisements

Web crawler in Java

Web crawler in Java :

Definition :

A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion.

For more information visit the wiki page for Web_crawler

Sample Java Program :

package com.test.main;

import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.net.URL;

public class WebCrawler {

/**
* @param args
*/
public static void main(String[] args) {
// TODO Auto-generated method stub
try {
URL url = new URL(“http://blog.iguddy.com/”);
BufferedReader br = new BufferedReader(new InputStreamReader(url.openStream()));
String temp = “”;
while(null != (temp = br.readLine())){
System.out.println(temp);
}
} catch (Exception ex) {
ex.printStackTrace();
}

}

}

 

 

Data Profiling Process

Data Profiling Process

After you create a data profile, you can run the profile session and view the results in a report.

The following steps describe the data profiling process:

  • Create a data profile.
  • Run the profile session.
  • View the reports.

1. Create a data profile. Use the Profile Wizard in the Designer to create a data profile based on a source definition and a set of functions. The Profile Wizard generates a mapping and a session based on criteria that you provide.

2. Run the profile session. You can choose to run the profile session when you finish the Profile Wizard, or you can run it from the Profile Manager. The Integration Service runs the session and loads the profile results to the Data Profiling warehouse.

3. View the reports. View the Data Profiling report associated with the profile session. Based on the type of profile report, you can view reports from the Profile Manager or from Data Analyzer.

 

Data Profiling Connectivity

Data Profiling Connectivity

 

Power Center Data Profiling uses the following types of connectivity:

  • TCP/IP.
  • Native.
  • ODBC.
  • JDBC.

TCP/IP. The PowerCenter Client and the Integration Service use native protocol to communicate with the Repository Service.

Native. The Integration Service uses native database connectivity to connect to the Data Profiling warehouse when it loads target data from the profiling sessions.

ODBC. The PowerCenter Client uses ODBC to connect to the Data Profiling warehouse when you run data profiling reports from the Profile Manager.

JDBC. Data Analyzer uses JDBC to connect to the Data Profiling warehouse when you run data profiling reports.

 

Data Profiling Components

Data Profiling Components

 

To understand data profiling, you need to be familiar with the following components:

  • PowerCenter Client.
  • PowerCenter Data Profile.
  • Data Profiling warehouse.
  • Data Profiling reports.

PowerCenter Client. Use the PowerCenter Client to create and manage data profiles.

PowerCenter Data Profile. Metadata that you generate in the PowerCenter Client that defines what types of statistics you want to collect for a source. It is comprised of a source definition, a profile mapping, and a profile session.

Data Profiling warehouse. The Data Profiling warehouse stores results from profile sessions and reports that you run to view the results.

Data Profiling reports. View data and metadata in Data Profiling reports.

PowerCenter Client

 

Use the following PowerCenter Client tools to create and manage data profiles:

  • Designer.
  • Profile Manager.

Designer. Create data profiles from the Source Analyzer or the Mapplet Designer. When you create a data profile, the Designer generates a profile mapping based on the profile functions. The PowerCenter repository stores the profile mappings and metadata. If the repository is versioned, profile mappings are versioned in the same way other PowerCenter mappings are versioned.

Profile Manager. A tool in the PowerCenter Designer that you use to manage data profiles. You can edit and regenerate profiles, run profile sessions, and view profile results.

 

PowerCenter Data Profile

 

A data profile contains the source definitions, the functions and function parameters, and the profile session run parameters. To create a data profile, you run the Profile Wizard from the PowerCenter Designer. When you create a data profile, you create the following repository objects:

  • Profile.
  • Profile mapping.
  • Profile session.

Profile. A profile is a repository object that represents all the metadata configured in the wizard. You create the profile based on a mapplet or source definition and a set of functions.

Profile mapping. When you create a data profile, the Profile Wizard generates a profile mapping. Select functions in the wizard that to help determine the content, structure, and quality of the profile source. You can use pre-defined or custom functions. The Profile Wizard creates transformations and adds targets based on the functions that you supply. You can view the profile mapping in the Mapping Designer.

Profile session. After the Profile Wizard generates a profile mapping, you provide basic session information such as Integration Service name and connection information to the source and the Data Profiling warehouse. The Profiling Wizard creates a profile session and a profile workflow. You can choose to run the profile session when the wizard completes, or you can run it later. When you run a profile session, the Integration Service writes profile results to the Data Profiling warehouse.

While profiles are not versioned, the profile mappings and profile sessions are versioned objects.

Data Profiling Warehouse

 

The Data Profiling warehouse is a set of tables that stores the results from profile sessions. It also contains reports that you run to view the profile session results. You can create a Data Profiling warehouse on any relational database that PowerCenter supports as a source or target database. Create a Data Profiling warehouse for each PowerCenter repository you want to store data profiles in.

 

Data Profiling Reports

 

You can view the results of each function configured in the data profile. Based on the type of metadata you want to view, you can view reports from the following tools:

  • Profile Manager.
  • Data Analyzer.

Profile Manager. PowerCenter Data Profiling reports provide information about the latest session run. View them from the Profile Manager.

Data Analyzer. Data Analyzer Data Profiling reports provide composite, metadata, and summary reports. View them from the Data Profiling dashboard in Data Analyzer. You can also customize the reports in Data Analyzer.

 

What is Data Profiling

What is Data Profiling

 

Data profiling is a technique used to analyze the content, quality, and structure of source data. Use Power Center Data Profiling to detect patterns and exceptions of source data during mapping development and during production. Use data profiling to make the following types of analyses:

  • Make initial assessments.
  • Validate business rules
  • Verify assumptions.
  • Verify report validity.

Make initial assessments. You can make initial assessments about data patterns and exceptions data during mapping development. As a result, you can design mappings and workflows on actual data, rather than make theoretical assumptions about sources.

Validate business rules. You can validate documented business rules about the source data. For example, if you have a business rule requiring columns in a source table to contain U.S. ZIP codes, you can profile the source data to verify that the rows in this table contain the proper values.

Verify assumptions. You can verify that the initial assumptions you made about source data during project development are still valid. For example, you may want to view statistics about how many rows satisfied a business rule and how many did not.

Verify report validity. You can use data profiling to verify the validity of the Business Intelligence (BI) reports.