Pertanyaan tentang perangkingan PT ala webometrik

Pertanyaan tentang perangkingan PT ala webometrik

Saya sering ditanya oleh beberapa rekan dan juga mahasiswa tentang perangkingan PT khususnya perangkingan yang dilakukan oleh Cybermetrics Lab (CCHS-CSIC) yaitu webometric. Saya memaklumi keingintahuan mereka mengapa PT dimana mereka bekerja dan kuliah kok ternyata rangkingnya rendah. Dalam persepsi mereka setidaknya PT mereka itu berada dalam  4 peringkat besar di Indonesia.  Menjawab pertanyaan yang disertai emosi tersebut biasanya saya hanya menjawab dengan cool, bahwa pertanyaan mereka tersebut justru menjawab tujuan dari diadakannya perangkingan ini oleh Cybermetrics Lab.

Sejak tahun 2004, laboratorium Cybermetric yang berkedudukan di negeri juara piala dunia sepak bola itu, memang telah mengadakan perankingan Web PT seluruh dunia (meliputi lebih dari 18.000 institusi perguruan tinggi di seluruh dunia) yang diumukan dua kali dalam setahun yaitu bulan January and July. Intensi mereka melakukan perangkingan ini adalah agar dapat memotivasi baik para petinggi institusi perguruan tinggi maupun para pakar (pendidik sekaligus peneliti) di institusi perguruan tinggi untuk dapat memiliki web yang dapat merefleksikan secara akurat aktivitas-aktivitas mereka. Itulah alasan saya dalam menjawab pertanyaan para cicivitas akademika yang dipenuh rasa emosi karena kecintaan pada institusi dimana mereka berada. Kutipan berikut ini yang diambil dari homepagenya webometrics di http://www.webometrics.info akan dapat menjawab pertanyaan tersebut: “If the web performance of an institution is below the expected position according to their academic excellence, university authorities should reconsider their web policy, promoting substantial increases of the volume and quality of their electronic publications”.

FAQ tentang isu ini dapat juga diunduh pada url berikut: http://www.webometrics.info/Webometrics%20library/FAQ.pdf.

Berikut ini saya sertakan FAQ tersebut. Questions and Answers about Webometrics ranking

July 2009

Is Webometrics a Ranking of university websites?

No. Web presence and visibility are used as indicators of global performance of a university taking into account its teaching commitment, the research results, its perceived international prestige and the links with its community, and with their industrial and economical sectors.

Web design is totally irrelevant as the core of the measurements are related to the contents published, especially those open access documents of academic interest or relevance.

Statistics related to number of visitors and so on are not taken into account because they correlate with the size of the institution.

What is the reliability degree of the Webometrics Ranking?

Our Ranking Web correlates highly with other Rankings, especially those based on research results. It has a larger coverage as it ranks more than 6000 universities worldwide and takes into consideration more university missions (not only research).

The main discrepancies refer to individual universities with mistaken web policies. Several institutions have two or more web domains, others have changed recently its main domain but still maintain a lot of information under the older one and even a few universities share domain with external organizations.

In other cases, if the web performance of an institution is below the expected position according to their academic excellence, university authorities should reconsider their web policy, promoting substantial increases of the volume and quality of their electronic publications.

But the quality is not strongly related to the research performance?

This is true for research-intensive universities, probably not more than a few hundred ones worldwide. This is unfair with many universities, such as the open universities or those focused in business, technology or languages that traditionally attract a lot of foreign students.

For the Webometrics Ranking, the research results are also very important. We collect number of publications of the open citation bibliographic database Google Scholar that has a good coverage of academic institutional repositories worldwide.

Is Webometrics Ranking produced by a truly independent organization?

The Ranking is produced by the Cybermetrics Lab, a research group of the CSIC, the Spanish public organization devoted to scientific research. We are not linked to any company, newspaper or nongovernmental organization. Our mission is to apply new quantitative methods to the analysis of Higher Education and our declared objective is to promote Open Access initiatives. As a non-profit initiative, we do not accept payment for inclusion in the Ranking nor offer advertisement banners to any university.

Are there known biases in this Ranking?

Every ranking system has shortcomings. Surveys are inadequate for large world rankings, correct figures are difficult to obtain for many bibliometric variables, weighting indicators are frequently controversial, and the interpretation of report cards is really difficult. Web Ranking combines in a single figure all the universities missions, but it not provides enough details to understand the relative contribution of each one. Good ranks are probably correlated with higher number of potential web authors (scholars + postgraduates), Open Access mandates, open or off-campus teaching and the technological focus (or level of investment in telecom and computer systems) of the university. Obviously, providing large quantities of quality English contents is also a great advantage.

What is your policy about data sharing?

Only the published data are available for non-profit purposes. We do not supply additional info to anonymous or commercial requests. For academic purposes we are open to share our results on the basis of joint academic projects.

Why the rank of universities does not go beyond the 6000th mark?

There are two reasons. One is methodological, as from a technical point of view the differences between institutions are very low and positions do not reflect actual differences. The second one is related to the objectives of the Ranking, if the university is not in the Top 6000, their scholars should focus in publishing more academic contents and not in what is your current rank.

Why previous editions of the Ranking are not available from the website?

Again there are two reasons. Firstly, as the methodology has changed (sometimes slightly, but for some editions considerably) the results are not comparable. We are trying to re-rank the older data with the new methodology but it is not an easy task, and it will not be ready soon. Secondly, the most important reason is policy related. Improving positions in the rank is not necessarily correlated with performance improvements of the institutions, so only current data is provided.

Only the ranks are provided and not the raw data.

The Web is very dynamic, search engines’ results are changing continuously so the numbers are only valid for the moment they are collected. Moreover, these numbers are obtained from a combination of several sources to decrease the engines’ biases using a very simple mathematical procedure (log-normalization and median). The resulting values are not useful for individual comparative purposes and even can be misleading or prone to manipulation.

Imperial College rank is much delayed.

Surprisingly a large number of universities maintain two or more main web domains that clearly penalize not only their Webometrics Ranking but more importantly their position in search engines and global internet visibility. Imperial College changed its domain several years ago from ic.ac.uk to imperial.ac.uk, a good move as the new domain includes the name of the institution. Unfortunately the university still maintains a lot of servers under the old domain in such a way that it is even a more popular and visible domain than the new one. Most of the universities marked with an asterisk (*) are in similar situations.

Are Korean universities websites underperforming?

The problem with duplicate domains described for the Imperial College affects to a large number of Korean universities. Most of the top institutions in this country have two web domains that explain in part their poor performance in the Webometrics Ranking. Other important aspects to be taken into account are the content design with a clear tendency to target students, and the low ratio of academic pages in English. The absence of large scientific repositories has also catastrophic impact.

Cybermetrics Lab (CCHS-CSIC)

isidro.aguillo@cchs.csic.es

Demikian kutipan dari sumber yang paling afdol untuk menjawab pertanyaan yang diajukan, mudah mudahan menjadi jelas adanya.

 

One thought on “Pertanyaan tentang perangkingan PT ala webometrik

  • July 15, 2010 at 7:29 pm
    Permalink

    Semoga perbaikan sistem informasi IPB yang sedang dilakukan membawa perubahan terhadap budaya pemanfaatan TI civitas IPB dan tentunya perbaikan citra IPB pada webometrics.

Leave a Reply

Your email address will not be published. Required fields are marked *